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PROGRAM RESTRUCTURING FOR VIRTUAL MEMORY SYSTEMS 


by 


Jerry William Johnson 


ABSTRACT 


The problem area addressed in this report* is program restructuring, 
a method of reordering the relocatable sectors (subroutine and data 
modules) of a program in its address space to increase the locality of 
the program’s reference behavior, thereby reducing the number of page 
fetches required for its execution in a virtual memory system. 


Theoretical upper and lower (optimum) bounds are derived for the 
paging performance of programs over all partitions of relocatable sectors 
into pages. 


Program restructuring techniques are developed which use intersector 
reference models based on sector working sets and sector stack distances. 
These intersector reference models identify the local reference behavior, 
and clustering procedures are developed that use this local reference 
behavior to rearrange sectors into pages such that significant 
improvement in paging performance is obtained. 


Results of measurements of paging performance obtained in the 
computer laboratory are discussed. The relationship between the paging 
per formance of a program restructured by the practical restructuring 
algorithms and the theoretical bounds on paging performance are compared. 


*xThis Technical Report reproduces a thesis of the same title submitted to 
the Department of Electrical Engineering, M.I.T., on June 15, 1974, in 


‘partial fulfillment of the requirements for the degree of Doctor of 


Philosophy. 
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CHAPTER 1 


1.1 Introduction 


In this chapter, the problem of restructuring programs to improve 


their paging performance in virtual memory systems is presented. 


1.2 Motivation 


As the use of multiprogramming and virtual memory techniques has 
become more widespread, the performance of paged virtual memory 
hierarchies has become more important. The fact that paged virtual 
memory systems can be made to perform efficiently at al! depends 
primarily on an inherent property of program behavior known as “program 
locality” (01,02,03,04]. Program locality arises from empirical 
observations that actual programs cluster their memory references so 
that, during any interval of time, only a subset of the information 
‘available is actually referenced. If a program is favoring a subset of 
its information at some particular time, we should like very much to have 
this subset in primary memory. As a result, much of the research efforts 
made to optimize the performance of programs in virtual memory systems 
were spent devising strategies for page management algorithms that could 


maximize the probability of finding in primary memory the information 


needed by the CPU at the time it is referenced, thereby sinimizing the 
number of page fetches. Several studies {81,82,021 have shoun that this 
probability strongly depends on the reference patterns of the program 
being executed, ‘that is, on how distributed in the virtual address space 
are the information items successively referenced by the processor. 
Generally, the Higher the degree of tocality of a program, the higher the 
performance of the virtual memory systen with respect to that program. 
However, several comparisons of page reptacesent atgorithas have been 
reported [B1,H1,Ci], often realizing as auch as 38 to 48 percent 
improvement from one algorithm to another for certain programs. In 
particular, an atgoriths has been found 81,1] that gives the ainimum 
number of page fetches for @ program. Even though the aininum 
replacement atgorithm is practically unrealizable, as it requires a 
knowledge of the future page references of the program every time a page 
fetch occurs, the algorithm is Important because one can use it as a 
theoretical beund against which the performance of any other paging 


algorithm can be compared. 


In ali the studies of developing page management algorithms to 
increase the performance of virtual memory systeus, the program’s page 
reference pattern and hence its locality is considered as a 
non-modifiable input to the system. In contrast to the exploitation of 
the existing locality of programs by paging algorithas, relatively little 
attention has been paid to another important method of obtaining better 


performance from virtual memory systems. This method is to increase the 


degree of locality of the program to be executed. Even less research has 
been focused on developing bounds on the performance improvement due to 


optimum program locality. 


In this report, we propose to focus most of our research efforts 
in the study of program restructuring [C2,H1,02], a method of rearranging 
the relocatable sectors (subroutine and data modules) of a program, to 
increase the locality of the program’s reference behavior and thereby 
reduce the number of page fetches required for execution in a virtual 
memory system. The essential idea behind program restructuring to bring 
about this localization in its reference behavior is to take sectors of 
the program that are used closely together in time and cluster them 


closely together in the virtual address space. 


1.3 The Nature of Program Restructuring 


The nature of program restructuring methods that have been 
proposed so far can be classified along several dimensions. With respect 
to the extent of the programmer’s involvement, restructuring can be 
manual or automatic, depending on whether rearrangement decisions are 
made by man or computer. With respect to the level at which 
restructuring is applied, we can make a distinction between external and 
internal reordering. In external reordering, the sectors which are 


rearranged in virtual memory are relocatable sectors of instructions 


and/or data. ‘Internal restructuring consists of reordering parts of 
relocatable sectors with respect to each other or simply deciding where 
to insert page breaks in the code K1,Y1J). External restructuring is 
faster and cheaper since it never requires reprogramming. With respect 
to the type of information. on which..a restructuring procedure is based, 
there are gtatic methods, which only-sake use of the knowledge of the 
static properties of the program, and dunapic methods, which are based on 
data, collected during execution, representing the dynamic behavior of . 
the program. 

Algorithms for automatic restructuring can be applied at 
compilation time if they ere static: lien cutagiae: aes those methods 
uhich construct @. graph aodel of the program te be restructured, whose 
sectors are repressnted by vertices (ukese weight is the size of the 
sector) and arcs represent the transitions (gata or control references), 
and then cluster vertices according to connectivity considerations or to 
the cyclic structure of the greph [B3,11,R1,¥2). Weare interested in 
automatic, external program restructuring methods based on the progranm’s 
dunamic behavior and in subsequent discussions we will simply call this 


programs restructur ing. 


In order to provide more insight into the character of programs 
restructuring which we will study, we make the following general 
assumptions. A program consists of a finite set of relocatable data and 
procedure sectors. These sectors are opaque, since we are concerned with 


the interactions among the sectors and we are not concerned with what 


goes on inside each sector. The average size of a relocatable sector is 
small with respect to the size of a page (between one-tenth and one-hal f 


page size). 


Informally, the basic approach to program restructuring is to run 
the program with a set of "typical" input data, record the sector 
reference behavior, formulate an intersector reference model based on the 
recorded information, and then apply a program restructuring procedure 
which uses the model of iter eector reference behavior to reorder or 
partition the sectors into logical pages such that the intersector 


references among sectors in different pages is minimized. 


The aim of program restructuring is to increase the locality of 
the program’s address reference pattern by reordering the relocatable 
sectors in virtual memory such that sectors that are needed within a 
relatively short time of one another are found in the same logical page 
or in logical pages that would otherwise tend to be in primary memory at 
the same time. The act of restructuring will tend to create a situation 
in which there are either very strong or very weak affinity bonds between 
logical pages. The resultant goal of program restructuring is to 
minimize the page fetches required by a program during its execution in a 
virtual memory system. This is a very difficult goal to achieve because 
the number of page fetches is a function of primary memory allocated to 
the program, the page size, the fetch and replacement policies, the 


sector reference behavior, and the selected ordering of sectors into 


logical pages. 


In order to pose sore formatiy the:-nature of the restructuring 
problem for :any program modeled by.a set of relocatable sectors of 
specified size and a-messured sector -trece describing the sector 


reference behavior, ve need the folloning definitions. 


A progras is regarded as a ‘directed graph G of m nodes, of size 
S,> 8, i = 1,...,m. The -nades:reprasent relocatable sectors. Let N be 
the page size, such that 6 < 5,;< -N for all i. Let C = (cy), 
i,j = 1,...;m-be-a-ueighted conmectivity matrix describing the edges of 
G. The edges of G represent the intersector reference behavior of the 
program. With edge (i,j) ts assaciated a cast c, > 8 of traversing 
that edge. -Hew to cheese the best intersecter reference mode! C from the 
measured sector trace is an isportent research problem. However, cj 
might represent the prebability that secter ji references sector j, or 
cy might be the total number of times sector i makes a data reference 
or a transfer of contro! to sector j, or ideally c, would represent 
the number of page fetches which would occur due to sector i referencing 
sector j in a given virtual memory system untess i and j were grouped 


into the same page. 


Let n be the number of logical pages of the restructured program. 
An n-way restructuring of G is a set of noneapty, pairwise disjoint 


subsets (pages) of G, p;,...,p, such that 


Un, Pi = G and [p,;| < N for all i, where |p,| stands for the 

size of subset p;, and equals the sum of the sizes of al! the sectors 

of Pi. The cost definition for the restructured G is the summation of 

Cj over all i and j such that i and j are in different subsets 

(pages). The cost is thus the sum of all external costs in the partition 
of G. A restructuring of G is optimal if it achieves minimum external 
cost or equivalentiy maximum internal cost, because the total cost of all 


edges is constant. 


We can now point to two distinct and difficult problems 
associated with program restructuring. One is, given G and C, how to 
find an optimum restructuring of G, and the other is how to model the 
intersector reference behavior C such that an optimum solution to the 
restructuring problem formulated on C gives the minimum number of page 


fetches for a virtual memory system. 
1.4 Importance of Program Restructuring 
The potential of program restructuring for improving the 


per formance of programs running in a virtual memory system can be best 


illustrated by citing some reported results. 


1.4.1 Comeau’: Results 


The first published results: of program restructuring to increase 
the per formance: of: programs in a virtual memory system was in 1967 by L. 
W. Comeau [C2]. Comeau reports: that the: ordering of relocatable sectors 
of code over virtual pages can have a profound effect on paging 
performance. I4v-perticular, he: found that the number of page fetches 
during an assembly could be decreased bya factor of five by changing the 
ordering of the menitor modules at load time, Four orderings of the 
monitor modules: nere compared under the sane prisery memory constraints 
and the sane paging: atgori thas. The atpheveticat ordering produced 65868 
page fetches, the random order gave 4286 :fetches, and order based on 
knowledge of the page size and: functions of the modules resulted in 2488 
fetches, and-an erdering based on the knouledge of the functions of the 
modules, page size and a detailed-histery of intermedule activity 


generated. while: the progras vas in execution produced 1288 fetches. 


A subsequent experiment by Tsaco, Comeau and Margolin ([T1], 
performed on an I18N/368 Mode! 48: in: a CP/48 environment, shows that 
paging activity is: reduced puch more by a- good load sequence of operating 


system subroutines. then by reptacement. sigor i thes. 


1.4.2 Resulte of Hatfield and Gerald 


In 1971 Hatfield and Gerald [Hl] reported that improvements in 
paging performance, on the IBMN/368 Model 67, in the range of two-to-one 
to ten-to-one can occur by using experimental techniques, based on 
information compiled from sector reference traces, to restructure the 
relocatable sectors of compilers, editors, and assemblers. This is a 
significant reduction in the number of page fetches experienced by 
existing, frequentiy executed programs, and how close this is to the 


optimum reduction is currently unknown. 


Also, they present an excellent discussion supported by many 
detailed measurements, which shows that the sector reference behavior of 
most programs they examined (especially the system programs: compilers, 
assemblers, editors, etc.) proved to be remarkably insensitive to the 
input data in rather ltarge domains. This is very important because there 
is no merit in tracing a program, massaging the traced data, reloading 
sectors, and measuring changes in paging rates if the improvement only 
holds for the particular set of input data used when it was being traced. 
Fortunately, the relative number of intersector references of many 
commonly used programs is rather insensitive to input data. However, it 
is certainly still true, especially for particular application programs, 

that the uniformity of intersector references over a range of input data 
should be established before sector reordering on the basis of 


intersector behavior is attempted. 
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In addition, they reported that program restructuring to increase 
the locality in progras reference patterns can have a such sore profound 
effect on paging performance in a virtual sewory systes than page 


replacerent atgor i thus. 


1.4.3 Program Design Considerations 


Another technique of increasing the degree of ltecality of 
programs, but certainly not the easiest to accomplish, consists of 
teaching the programmers hou to design sore focal programs [84,85,61,11), 
making them aware of the important language transistor considerations, 
providing them with unambiguous feedback about the paging performance of 
their programs and showing them how the system penalizes those programs 
which exhibit @ poor degree of locality. The typtcal attitude of virtual 
memory system designers may be expressed by Denning HZ) when he states, 
“it is not known whether programmers can be properly educated, inculcated 
with the ‘right’ rules of thumb, so that they habitually produce programs 
with "good" tecality." Unfortunately, the freedem of the programmers 
from the need to werry about physical memory space and its management in 
a virtual memory system is a major obstacle to their education in the art 


of locatity. 


Therefore, especiaily for frequently executed programs such as 


Operating systems, assenblers, compilers, editors, production programs, 


11 


etc., we can see the appeal and the potential rewards of the program 
restructuring approach, that is, to design the program without 
excessively caring about its locality, and then to rearrange its 
relocatable code and data sectors in the virtual address space so as to 


make its reference pattern more local. 


12 


1.4.4 Related Performance Benefits 


If we can reduce the number of page fetches required by program 


restructuring, we will get improved performance in several areas: 


1. Reduced time spent paging. 
2. Less supervisory overhead spent in main 
\ 

memory and paging management. 

3. Better throughput on the average, because a 
program will interfere with others less. 

4. Better paging operation when it is needed, 
because there will be less contention for the 


paging device. 


1.5 Related Research and the Need for Further Research 


The only comprehensive research in the area of automatic program 
restructuring was reported ti Hatfield and Gerald [H1]. The essence of 
their work can be interpreted in the following context. A program 
consisting of m relocatable sectors occupying n logical pages of virtual 
memory Was run with a typical set of input data and sufficient 
information was recorded during the run to produce a complete sector 
trace. A complete sector trace is the time sequence of ail sector 


references (instruction and data references) during program execution. 
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A "nearness matrix" C for modeling intersector behavior was 
constructed from the sector trace. The nearness matrix is an mxm matrix, 
whose entry C,(l1 < i < m, 1 < j < m) is the number of times sector j 
followed sector i in the sector trace or equivalently the number of times 
sector i referenced sector j during the execution of the program. This 
matrix is equivalent to a directed graph G of m nodes where the arc from 


node i (corresponding to sector i) to node j has C as its weight. 


No computationally feasible procedure was found to produce and 
prove an optimum restructuring of G, based on C, into pages, i.e. one 
that minimized the summation of Cj over all i and j such that sector 
i and sector j are grouped into different pages. Instead heuristic 
approaches were used to restructure G. One method used essentially the 
largest values of the eigenvectors of C as a basis for grouping sectors 
together. Another heuristic approach which gave slightly better results 
Was a procedure which attempted to cluster sectors into pages, under the 
constraint that the size of each cluster be no greater than the page 
size, such that the square of the interconnecting weighted arc distances 


between pages were minimized. 


The latter heuristic approach is quite similar to the procedure 
reported by Charney [C3] which partitions a network of interconnecting 
components into groups of components such that the total number of 


interconnecting wires between groups tends to be minimized. 
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As Hatfield and Gerald pointed out, a disadvantage of program 
restructuring forsulated on the nearness matrix C is that the nearness 
matrix contains global information about sector interaction, whereas 
paging depends on focal reference patterns. For example, consider tuo 
sector reference traces S, and S,.. Aseume that sectors i and j are 
referenced exactly k times in both traces. Let S,= a, (ij)" a", and S, = 
a, Ci jag * where a, and a2 represent long sector reference 
strings. The value C,; is k in both cases and C, is larger in 
S,- Therefore, the probability that the clustering algorithm will 
group i and j tegether is greater for S,; than S,. Hewever, the cost 
of not grouping them together is greater for S,, since the number of 
page fautts due to the references j iwmediately following those to i will 
be at most I for S, for all real semory sizes greater than one and can 
be k for S, for certain a,’s. In other werds, even an optimum 
solution of the restructuring problem formulated on the nearness matrix 


may not give the minimum number of page faults. 


Hatfield and Geraid realized that there are many cases where the 
nearness matrix alone does not have al! the information needed for 
producing a good sector ordering and that the ordering obtained by the 
restructuring algorithm from the availabie information is based on 
heuristics. Accordingly they supplemented the automatic sector 
reordering phase uith a hand finishing phase of additional sector 
reordering based on complex human interpretation of the program’s use of 


virtual memory over the course of its execution as displayed via an 
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interactive graphics package. Even though the reordering phase based on 
human decisions provided additional improvements in paging per formance, 
it can be quite time consuming, and the results are soneuhat dependent on 
the imagination and insight possesed by the programmer making the 
decisions. Furthermore, the absence of any knowledge about the maximum 
possible improvement makes it difficult to determine a suitable stopping 


point based on some cost-performance criteria. 


In order to determine if a new ordering is actually better or 
worse than an old ordering, they simulated the paging performance of each 
ordering over a range of primary memory sizes and page replacement 
policies. Evaluation of sector orderings by simulation can be an 


expensive process if many sector orderings are compared. 


Based on the current state of research into the problem of 
program restructuring as discussed above, we can identify several areas 
of potentially rewarding research. We will assume that a program is 
modeled by a set of relocatable sectors of specified size and a sector 


trace describing the sector reference behavior. 
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1.5.1 Intersector Reference Models 


We need a. model. of. intersector reference behavior C, defined over 
the sector trace, that incorporates sore of the local reference behavior 
of the program upan which paging actually depends than that captured by 
the nearness matrix. For example, the probability that a reference from 
sector i to sector j will cause a page fault is related to such local 
information as the time elapsed since the last reference to sector j and 
the number of distinct sectors referenced since the laet reference to | 
sector j in the sector trace. If the thee is short since sector j was 
last referred to and little virtual memory apece vas used during that 
time, it is prebable that sector j is still in primary memory and a new 
reference will not cause a page fetch. If the time and space traversed 
between references to j are large, it is probable that a page fetch will 
occur unless j is grouped into the sane page as the referencing sector or 
some recently referenced sector. We propose to formulate and investigate 
tuo. approaches which seem to have potential for identifying and . 
quantifying local secter reference behavior which can be used to ueight 
C, entries. These approaches are based on sector working sets and 


sector stack distances defined over the sector trace. 
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1.5.2 Reordering Procedures 


Another area eciicer ris finding better procedures for restructuring 
or grouping the m relocatable sectors of a program into n logical pages 
such that the reordered program achieves or tends to achieve the minimum 
external cost formulated on an intersector reference model C. A strictly 
exhaustive procedure for finding the minimum cost grouping is often out 
of the question. To see this, consider the simple problem of dividing m 
sectors into pages containing g sectors each. The total number of 


groupings is as follows: 


Groupings = m! 


(g!)™8 (m/g) ! 


For most values of m and g, this expression yields a very large 
number; for example, if m = 48 and g = 4, it is greater than 192°, 
Formally, the problem could be solved as an integer linear programming 
problem, with a large number of constraint equations necessary to express 
the uniformity of the partition [Jl]. However, since it seems likely 
that any direct approach to finding an optimal solution will require an 
inordinate amount of computation, the quest for better heuristic methods 
appears to be the best approach. The first and foremost consideration in 


developing heuristics for combinatorial problems of this type is finding 
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a procedure that is powerful and yet sufficiently fast to be practical. 
A process whose running time grows exponentially with the number of 


sectors is not likely to be practical. 
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1.5.3 Sector Ordering Evaluators 


A computationally inexpensive evaluator of sector orderings is 
needed so that a new ordering can be estimated as better or worse than an 
old ordering without simulating paging performance for a primary memory 


size and page replacement algorithm. 


One theoretical approach recentiy reported by Sekino [S4] may be 
applied, given a sector ordering into pages and the probabilities of 
sector i referencing sector j for all i and j, to compute the page fetch 
probability. However, a major drawback of this approach is that after 
the probabilities of going from one system state to another are: computed 
(where a system state is determined by the r pages of an n page program 
in primary memory, the page being referenced, and the state of the 
replacement algorithm), then, even in its simplest formulation, the 
solution of r«(?) simultaneous equations are required (a solution 
computationally infeasible for values of n and r usually encountered in 


real programs). 


Another approach relies on the ability to construct a matrix 
model describing the ih arnee reference behavior from the sector 
trace, given additional knowledge about the size of available primary 
memory and the paging policies, such that the cost of a sector ordering 
(i.e. the cost of the interpage arcs cut) produced by a reordering 


algorithm, is proportional to the number of page fetches expected for 
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that ordering. How successful is this approach or any other 
computationally inexpensive approach is an open research question, but 
the existence of this probisa and the potential expense of any solution 


points out, in part, the immense value of the next research topic. 


1.5.4 Per formance Bounds 


The tremendous!y large nusber of eector orderings, and the 
difficulty end expense invaived both in. choosing a. celatively good 
ordering and in evaluating a.neu.orderiag.ss bstter.or uorse than an old 
ordering illustrate the vital nead .to. neve .theeretical. bounds on the 
optimum improvement in: the paging performance of virtual memory eyetens 
through prograa-raatruc.tur ing. - 


If beunds-.on the niniaua number of page fetchas which could occur 
during execution of a progras for any reordering of relocatable sectors 
into logical pages were known, they could be used: to determine whether 
or not a given program should be considered for restructuring based on 
its current paging performance; to evaluate the results of a 
restructuring procedure, whether autematic, manual or both, for a given 


program; and to necagnize when a good. pregran structure ie found. 


Automatic restructuring procedures based on heuristics appear to 
be the only computational ly feasible approach. It is unlikely that any 
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one procedure will provide near optimum solutions for all programs. One 
attractive methodology for program restructuring when bounds on the 
optimum performance are known is to have a set of automatic restructuring 
procedures available which can be successively applied to a particular 
program until a reasonably good solution is obtained. In the case when 
no reasonably good solution is found automatically, a decision to 
‘gonsider manual restructuring and its extent can be made based on the 


potential for additional improvement versus its expected cost. 


The theoretical work reported in the literature to date in 
developing bounds on the paging performance in virtual memory systems 
that can result from program restructuring is nil. We will present a 
formal approach to this problem and some preliminary results in the next 


two sections of this report. 


It is our objective to develop upper and lower bounds on the 
number of page fetches which can occur over all reorderings of sectors 
into logical pages of a program, for any program modeled by: a set of 
relocatable sectors of specified size, a sector trace describing the 
intersector behavior, any two-level virtual memory system modeled by its 
page size, primary memory size available to the program, and page 


replacement and fetch policies. 
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1.6 Summary cf Goals 


The goats of this thesis are as fol lous: 


1. 


Forwatize and anatyze thre effect of the 
structural ordering of 2 program’s relocatable 
eectore upen its paging performance in 


virtual memory syotens. 


Devetop theoretical bounds on the optimum 


impreversent in the paging performance of 


prograss in virtual memory systems which can 
result from restructuring the retecatabie 


sectore of programs. 


Develop theoretical bounds on how “bad” the 
paging performance of programs can get if the 
“worst” ordering of retocatable sectors is 


chosen. 


Formalize new models of program reference 
behavior, such as intereector reference models 
based on sector working sets and sector stack 
distances, and analyze their effect on reordering 


procedures for improving the paging per formance 


23 


of programs. 


Design and develop practical algorithms for 
restructuring programs to improve their paging 


performance in virtual memory systems. 


Perform measurements to compare the relationship 
between the improvements in paging per formance 
produced by these practical algorithms and the 
optimum improvement specified by the theoretical 


bounds. 
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‘CHAPTER 2 
FURMALIZATION: OF VIRTUAL MEMORY SYSTEMS 


2.1 Introduction . 


In this section a formalization of the fundamental 
characteristics of two-level vitiusl seuerg systems is presented and 
certain bartanwance medusa ace derived. The purpose of this chapter 
is to develop the terminology and the framework necessary to view this 


research in its preper perspective.. 


2.2 Major Parameters of a Two-Level Virtual Memory Systen 


Figure 1 and Table 1 present the major parameters of a tuo-level 
virtual memory system. These parameters can be grouped into three 
categories: (1) Configuration, (2) Automatic Management Algorithms, and 


(3) Program Behavior. 


. 22.1 Configuration 


Virtual memory is assumed in this thesis to be implemented by 
Paging on a two-tevel hierarchical physical memory system consisting of 
primary memory, Mp, and. secondary memory, Ss. (Note that we have chosen 
the notation Ss for secondary memory, i.e., secondary storage, because 
the dotation Ms would lead to notational conflicts tater in this 
report). Each storage device is partitioned into physical blocks called 
pages. A page is the basic unit of information transferred between Mp 
and Ss. The page size (usually 4,696 or 2,848 bytes) is denoted by N. 
Each memory device is further characterized by its random access time 
T,, transfer rate B;, cost/byte C,;, and capacity in pages jf; |. 


We assume that Tp < Ts, Bp > Bs, Cp > Cs and [Mp| < [Ss]. 


1. Mp is the- primary. store 
2. Ss is. the: secondary: store 


34. [EL | ie the size in pages: of the i-th store. 


4. B; is the: transfer rate of the i-th store 

S.. C, ie the-cost/unit: of- the: }-th-atore 

6.. T; is the average: access: time of the i-th store 
7. ON; is: the number of bytes in. a page (page size) 


1. F is: the: fetch algerithm 
2. R is the replacement: algori the 


Program Behavior 


1. A is the- logical address trace 


Table 1 


Major Parameters of Tuo-Level 
Hierarchical Virtual Memory Systems 
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B}. 
Processor 
A = a, 94» eee 


(Tv, By) 


Processor 
A =a, 942» eee 


C). 


(Cp, |Mp| ) 


(Ts,Bs,N) 


IBN/368-67  18M/378-165 

Mp Core Cache 

|Mp| 192 pages 16K bytes 
Cp $1.53/byte  8.88/byte 
Tp 375 ns 168 ns 

Bp 2iMb/s 188Mb/s 

Ms Disk Main Store 
|S.) 2848 pages 512K bytes 
Cs $80.84/byte  %$8.58/byte 
Ts 8.6 ms 1.44us 

Bs 1.2Mb/s 16Mb/s 

N 4696 bytes 32 bytes 
Tv 885 ns 238 ns 

Cv $8.18/byte  %8.77/byte 
|v] 2848 pages 512K bytes 

Figure l. 


A). Two Level Storage Hierarchy System. B). Virtual or 
Composite Memory System. C). Representatative 
Parameters for Several Virtual Memory Systems. 
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2.2.2 Program Behavior 


The processor, under program control, generates a sequential 
sequence of references to the storage systen. The processor references 
are in the form of togical address references or virtual memory 
references which serve to uniquely identify each unit of stored 
information independent of tts location. in Mp or Ss. The time sequence 
of logica! address references is called an address trace, A and is 


defined as; 
A = a! ,a%,...,a'. 


Each togical address, ai, may be separated into a logical page 
reference and an offset within that logical page. This separation 
process is pictorially illustrated in Figure 2 where the set of 2x%n 
possible addresses are partitioned into 2xn, pages of 2%«xn, = N 
logical addresses each. The time sequence of logical page references is 


called a page trace, P and is defined as: 


P =p! ,p?,...,p' where p'= integer (a'/N). 
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je -n-bits +p| 


a)Logical Address 


———-——_—_———. n-bits >| 

ae { 
| Page Displacement 
Mey -bi ts —ehe ng -bits———— > 


{(n =n; + no) 
b) Logical Address Partitioned into 


Page Address and Displacement 


Figure 2 


Logical Address Structure 
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Information movement between Mp and Ss is accomplished by 
transferring pages between Mp and Ss. ke can analyze inter level 


movement for address trace A by consider ing the corresponding page trace 


Ps 


One method of constructing a representation or model of a 
complex activity such as program behavior is to first analyze a 
particular characterization and then gradually introduce additional 
detail. In the case of program behavior, it is convenient to begin by 
considering onty the address trace and the corresponding page trace. 
Later, we will consider the effect of the Secgrin’ a wtbuctuee on its 


behavior. 


2.2.3 Automatic Managesent Algori tha 


Since a processor can service only that portion of a program 
which resides within primary memory, which is relatively small in size, 
the dpacating system must exercise a special algorithm, called a paging 
algorithm, to keep the "most active" pages of a program in primary 
memory. This is accomplished by transferring pages of the program back 
and forth between primary and secondary memories. The goal of a paging 
‘algorithm is to maximize the number of times logical information ts in 


the primary memory when being referenced. 
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The paging algorithm must consist of two basic policies. The 
Eetch policy, F, decides when and which information should be moved up 
from Ss to Mp. ‘The Rep!acement policu, R, decides when and which pages 


should be transferred down from Mp to Ss. 


Definitions 
1. Q = {a,b,...} is a finite set of logical pages 
2. P= p!,p?,...p' is a page trace with p'e Q. 


3. Mh Q is the contents of Mp at time t. 


> 


F=f! f7,...¢' is a finite time sequence of L sets, 
fhcQ,l<ct<lL. 
5S. Ree! r?,...,r¢= (6) is a finite time sequence 

of L sets, ric Q,1 <t<lL. : 

6. m= UN! rho u yl ct <b. 

7. F and R are valid if fin Mt! = ort mt! 

and pie mn, 
l<t<«l. 

The F and R policies are defined to denote a particular 
realization of a paging algorithm for a given trace P. For a page trace 
and initial primary memory state M,, a F-policy and a R-policy 
together determine the time sequence of primary memory states that will 
occur as the virtual memory system processes the trace. We will 
consider only valid F and R policies. That is, none of the pages 


fetched at time t, f', may be in primary memory at time t-1; the set 
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of pages removed at time t, p', must be in primary memory at t-1; and 


the page reference at tine t, p', must be in primary memory at time t. 


2.3 The Virtual Storage Medel 


A tuo-level hierarchical virtual storage systen, VV, is composed 
of all the parameters described above: 
Vi a= ficanti gucat ton <iceuren bakalenk. <algantinees! 
Vv = f(<([Mp|, Tp, Cp. Bp, |Ss],Ts,€s,B88,N>,<A>,<F, R>) 


The rationale for tuo-level hierarchical virtual memory systens 
as shown in Figure 1 is to couple expensive tow capacity fast memories, 
Mp, with inexpensive large capacity slower memories, Ss, such that the 
composite or virtual memory system approaches the. speed of the expensive 
memory and the capacity and cost/unit of storage of the inexpensive 


memory. 


2.4 Performance Measures 


The rationale for a virtual memory system, V, immediately 
suggests three measures of its effective performance. These three 
measures are its effective capacity [Mv], effective cost/unit, Cv, and 


effective access time, Tv. 
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2.4.1 Effective Capacity 

The effective capacity [Mv] = |Ss| is achieved through the 
paging algorithm of the virtual memory system and the constraint that 
all logical pages initially reside in Ss. 


2.4.2 Effective Cost 


The effective cost Cv is defined as follows: 


Cv = ColMpl+CsiSs| 
IMp|+|Ss} 


The effective cost Cv is seen to approach the cost Cs under the usual 
condition that the size of secondary memory is much larger than the size 
of primary memory. 


2.4.3 Effective Access Time 


For simplicity in developing techniques for analyzing and 


providing insight into the much more difficult problem of the effective 


4 


access time, Tv, ue will first consider a demand fetch policy, Fy . 


Later, our considerations will focus on other fetch policies. 


Assume that, at time t, the processor generates a logical 
address reference a', which refers to page p. At that point ‘in time, 
the page p may reside in Hp or Ss. Under a demand fetch policy Fd, if p 
is in Mp, the reference proceeds and ‘no page wovement occurs. 
Otherwise, if p is in Ss, a tate Facts oe gage fetch occurs and the page | 
is automatically transferred to Mp and the reference proceeds. If Mp 
were already fuli, the removal policy, R, must be eaptoyed to remove 


some page in tip to provide space for the nen page request. 


Formally, a demand page fetch policy Fd, for a virtual memory 


system V is defined as follows: 


Recali that 

1. P= p',p?,....p' is the page trace determined from A 
and N. | 

2. Fg= f4,%,...,f4 is a valid fetch policy. 

3. Rer',r?,...,c¢ is a valid removal policy. 


4. Me ent! ushpert. 


Definition of Fy 


1. If ple M5! , then the rag. 
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2. If ple Mb! and INt! p<iMpl, 
then fi = {p' } and r' = ¢. 

3. Tf ple MS! and [M'S'l=iMpl. 
then f= (p'} and r= tal 
where ac MY! and a is selected by 


the removal algorithm. 


Under demand paging, the primary memory Mp simply fills as 
required by 1 and 2, while the first |Mpj pages are referenced. 


Subsequently, referenced pages are swapped between Mp and Ss as required 
by 1 and 3. 


Let FFp, the number of page fetches from Ss during the 


processing of a page trace P, be defined as the page fetch function and 


its value given by: 
FFp = ob, ety. 


By analogy to the page fetch function, the number of references 


satisfied by Mp is called the page success function, SFp, and it can be 


computed as 


SFp = |P|-FFp. 
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The effective access time, Tv, of a virtual memory system V, is 
defined as follows: 

Tv = EFpTs + (1-(EEp)) Tp 

IP] «PA 

The value of the effective access time Tv, is seen to approach 
the fast access time Tp, of primary memory as: the value of the fetch . 
frequency function, FEp/|PI, is reduced toward zero or equivalently, for 
a given page: trace P, as the vatue of the page: fetch: function FFp 
approaches zero. Therefore; we see that the vatue of FFp is a crucial 
measure of the performance of a program ina virtual wemory system. In 
general, we uish to minimize the page fetch jonation in order to 


minimize the effective access time Tv. 


2.4.4 Page Trace Simulation 


One method to. determine the value of the dege fetch function 
FFp, for a given virtual memory system V is to compute the resultant 
page trace P, from the address trace A and the page size N, then 
simulate the paging algorithms, F and R, and record the contents of Mp 
at each step of the page trace. Table 2 illustrates this step-by-step 
simulation, assuming. demand paging and LRU {Least Recently Used) 
removal. The contents of Mp are shown ordered to reflect the LRU. 
ordering: the top page is the page most recently fetched into Mp: the 


bottom page is the page least recently used by the program and is the 
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Virtual memory system V = f (<|Mp|, Tp,Cp,Bp, |Ss{,1s,Cs,Bs,N>, 


<A>, <F,R>) with parameters 


A=a', a pooe, ale 


P = a,b,a,b,c,c,b,a,a,b,b,a, where p' = integer (ai /N). 
However, we have used lower case letters to represent 
logical page addresses instead of page numbers because 
it simplifies the presentation. 

[P| = 12 

Q = fa bc} and {Q| = 3 < |Ss| 

IMp| = 2 

F = demand fetch, Fy 


R = LRU replacement, Ripy 


Simulation: 


12345678918 11 12 


Page Trace,P ababccbaa a 


Remove Riry 
nM! contents ababccbaab b a 


after time t 


ab8@@c8GBaB 


8@8@8asGBcB 


ababobchbob 


RESULTS: 


FFp = 212, fh = 4 


EFp = 4/12 
IPI 


Tv = IS + 2Ip 
3 


Ww 


Table 2 


Example of Page Trace Simulation to Determine FFp 
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page selected for removal when necessary. 


2.5 Page Fetch Function Per formance Model 


From the above discussion, de observe that several parameters 
of a virtual memory system Vef(<j|Mp|,Tp,Cp, 8p, [Ss|,Ts,Cs,Bs,N>, <A>, 
<F,R>) influence the vatue of the page fetch function, FFp. These 
parameters are the page size N, the mapa e-dtereue reference pattern 
A, and the removal policy R, the fetch policy F and the size of primary 


memory |Mp|. Therefore, we define 
FFp = FFp(|Mp{,N,A,F,R). 


- The significance of all these parameters on the page fetch 
function measure will be considered and investigated. Special emphasis 
will be focused on analyzing and understanding the relationship between 


the program’s structure and the logical address trace. 


We will not elaborate in great detail, but it should be pointed 
out fatter hierarchical ly-structured virtual memory systems of more 
than tuo levels, say K tevels, and demand paging (those studied by 
Madnick {M31}, we can derive the effective page trace and thus the page 
fetch function for paging to the i-th level from level i-1 (level 1 is 


primary memory). To illustrate this, note that the resultant fetch 
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policy at level i-1, F., = CS nee Ae 

is essentially the page trace P; for level i. There is an easy 
compression of F,, to omit the values of fl, @ and a 

minor relabeling required to adjust for the difference in page size used 
by Mand M_, of P! = ff, (N_,-1/N,). This 

procedure is applicable for all levels 1 < i < k, and the goa! of a 


k-level memory system is to minimize > Ase FFp;* Tp; + 


2.5.1 Replacement Algorithm Considerations 


Even though we will be primarily concerned with the effect of a 
program’s structure on the value of the page fetch function, FFp, we 
need to consider some important effects of the page removal algorithm on 
FFp. Many removal! algorithms have been proposed and studied in the 
past, such as First-In-First-Out (FIFO), Least Recently Used (LRU), and 
Belady’s [B1] Optimum algorithm (0). We wil! define these removal 
algorithms under demand fetch to illustrate hou particular al gur ities 
may be specified in our general! mode! of removal policies, and to 
establish exactly what these algorithms mean, since they will be 
referred to frequently in the remainder of the thesis. Furthermore, we 
have chosen to discuss this particular subset of removal algorithms 
because they will enable us to present several important and well known 
properties of removal algorithms which will eventual ly be needed in our 


research. Let: 
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1. P= p! pp? ,.oes pt be a page trace computed from 
A and N, 
2. |IMp| = number of page frames in primary memory, Mp. 
3. Mp'= the set of pages in Mp at time t. 
4. Fa = €),#3,...,¢4) be a demand fetch policy as 
previously defined. Recall that the 
definition of Fd specifies all the 
mechanics of paging except the page to be 


selected for replacement. 


The LRU removal policy, Rigy, is defined for demand fetch, Fd, 
as Ripgy = clay of eeu oes oP ipy where 
rieu = @ if f§ = @ or [Mpc] < [Mpl; otherwise, 
riay = a, where a is the page in Mp which jae least recently 


referenced. 


The optimum removal policy, Ro, is defined for demand fetch, Fd, 
Ro = pore oe cas where ri = @ if f)= ¢ or 
[Mpt < [Mp]; otherwise, rt = a, where a is the page 
in Mp*! with the longest future time to next reference in the page 


trace, P, fromp'. If ac Mp! is never referenced again, then 


its time of next reference is assumed ta bem. If a page must be 


removed at time t, and several pages have the same longest future time 


to next reference (i.e., all equal to  ) then remove any one of the 


pages. 
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Under demand fetch, the First-In-First-Out replacement policy, 
Rriro is defined as 
R = 1 2 L 
FIFO = "FIFOs "Fifoss++sPFipg Where 
rho = ¢ if f= @ or [Mp <|Mp]; otherwise, 
rhiro = a where a is the page in Mp! which has been in 


Mpt! longer than any other page in mph! 


We now present several well known properties of these rep!acement 


algorithms. 


Lemma 1. 

For a given page trace, P, primary memory size of [Mp| page frames, 
and demand fetch policy, Fd, then the number of page fetches using any 
valid removal policy Ra is greater than or equal to the number of page 
fetches using the optimum replacement policy, Ro. The proof of this 


Lemma can be found using various techniques in [Al,M1] and is not 


repeated. here. 


Inclusion Proper ty: 
Under demand fetch, Fd, any replacement policy is said to satisfy 
the inclusion property if for all page traces, P, 
a. Mp! (1) c Mp! (2) c ... c Mp (n), where Mp' (j) is the 
contents of primary memory Mp at time t if the size of Mp is j page 
frames (ij.e., |Mp| = j), 1 < j <n. 


b. At any time t after Mp has become filled, there is a strict 


replacement ordering referred to as the “replacement stack,” RS, 
RS = rsti),rst2),-..,rstn), where estj) = Mp! (j)-Mp' (j-1) for 


j 2 1,2,...,n, and rstn} is the page to be removed next. 


The general class of demand-fetch reptacement algorithms which 
satisfy the inclusion property are referred to as “stack algorithms” in 
the literature. The class of stack algorittws, as noted by Denning 


(01), “contains at! the reasonabte algori thes.” 


Lemma 2. 

The number of page fetches required by any stack algorithm for any 
page trace is a monotonic function of primary mewory size, [Mp], in page 
frames. To see this, note that if there is a fetch at time t for a 
primary memory of a given size, there must also be one at time t for 
every primary memory of owal ter size. The psa ots tite Lemma can..be 


found in 1,11). 


Lemma 3. | 

Demand fetch with LRU removal and demand fetch with Optimum 
replacement are stack atgor i thaw. The proof of this Lenwa can be found 
cin (mil. : es 

We will refer to the above well-known properties several times in 
the rest of this thesis. At this point in time, ue can immediately 


conclude that, for any [Mp] and A,. 
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a. FFp(|Mp[,N,A,Fd,Ro) < FFp(|{Mp{,N,A,Fd,Ra) from Lemma 1, when 
Fd, Ro are demand fetch and optimum removal policies and Fd, Ra are 
demand fetch and any removal policies. 

b. FFp({Mp|,N,A,Fd,RAigy) < FFp {{Mp’|,N,A,Fd,Rigy ) and 
FFp(|Mp{,N,A,Fd,Ro) < FFp(|Mp’ |,N,A,Fd,Ro) from Lemmas 2 and 3 


where |Mp| > [Mp’*|. 


Due to its simplicity, the FIFO replacement algorithm was used in 
many of the early paging systems. In recent ines it has been 
discovered that FIFO has certain disturbing pecularities, such as the 
possibility that the number of page fetches will double for a memory 
size increase of one page frame [Al,M1]. Hence, FIFO is not a stack 
algorithm, and we cannot claim that, for any A and |Mp], 
FFp(|Mp|.N,A,Fd, Reco) < FFp({Mp’|,N,A,Fd, Reig), where 
IMp|>|Mp’ |. 

. Thus, we observe that the inclusion property of stack algorithms is an 


important proper ty. 


Various forms of the LRU replacement Sigocithw frequently occur in 
contemporary virtual memory systems. Empirically, LRU replacement has 
been found to closely approximate the paging performance obtained by the 
optimum algorithm for many aetanl programs. The optimum policy is not 
physically realizable since it requires future knowledge about reference 
behavior, but it can be used as a theoretical basis for per formance 


comparison with practical algorithms. However, the value of the page 
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fetch functien, 
FFp(|Mp|.,N,A,Fd,Ro)-=.2t, el is. physically realizable (66) 


since it does not require future knowledge. 


For any page trace P = p! .p?,...,pt and primary memory size 
{Mp|, Belady has given a one-pass procedure which will compute the value 
that Fi | would take on under optimum Renova for anyl<t<L 
without any knowledge. of the page trace after t (i.e., 
pt! jp? ,...,pt). In particular, this procedure determines 
whether ie | =.1 or fy | =.@,- but it does not specify of what 


page tt consists. 


2.95.2 Program Structure Considerations 


In this section, we will extend the page fetch function per formance 


model to account for the program’s. structure. 


The programs we consider are defined to consist of a set of 
m relocatable sectors of specified sizes. The Recadiune ete program is 
specified by a particular load ordering sequence of its sectors in its 
virtual address space. This ordering is called a aector ordering SO, 


and is defined as 


4S 


SO:-<:Sj-5Sp40ks Sp 


where S, denotes the first, Sp the second, and S, the fast sector 
loaded in the virtual address space. Thus a program can have m! 
distinct structures, one for each possible sector ordering, so. 
However, once a sector ordering is chosen, it does not change during the 
execution of the program. Let |S,| be the size of the jth sector and 
let L|S; | be the load address of S; in the virtual address space of 
the program. If the sectors are loaded contiguously in virtual memory, 
then LIS; | = pa |S; |. In any event, we assume that the 
structure of a program is completely specified by its sector ordering 
SO, which is further defined to include the size and load addresses of 
all its Sseetore: Therefore the sector ordering SO of a program 
specifies the load sequence, S;,S,,..-, S,, and the values of 
|S; |] and LIS;| for all l <j <m. 

We have previously modeled the program behavior by its logical 
address trace A = a ga? oe ee at and have shown that the address 
trace A and the page size N are sufficient to determine the page trace 
P = ne: ane pi. However, the address trace and hence the page 
trace depends on the particular sector ordering chosen for the program. 
. For example, if a', the logical address referenced at time t , is 


t 


Within sector j, then the value of a depends on where S; is in the 


sector ordering SO. 
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In order to study the effect of a program’s structure on its paging 
per formance, we will model a program’s behavior by its sector trace. 
The sector trace ST of a program is defined to be the time sequence of 


sector references and is given by 
st = s',s?,..., st 
where S' denotes the sector referenced at time t. 


Given the logical address trace A corresponding to a specific 
sector ordering SO, the sector trace ST can be easily eiapatee from the 
load addresses of the sectors. Then this sector trace can be used to 
compute the page trace resulting from any program restructuring 
specified by a new sector order ing if the sectors do not cross page 


boundaries. 


In particular, given a program modeled by its sector trace ST and 


its sector ordering SO, the page referenced at time t, p', is given by 
p' = integer (LIS'| /N), 


where S' is the sector referenced at time t in the sector trace ST, 
Lis'| is the toad address of sector s! given by the sector ordering 
SO, and N is the page size. We are assuming at this point that 


individual sectors do not cross page boundaries. 
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As long as this is true, we can define the restructuring of a 
program as a partition of the relocatable sectors into fogical pages. 


In particular, let, 


1. Q = {S, ,S,...,Sm} be the set of relocatable 
sectors making up a program. 
2. n= the number of logical pages of size N of the 


restructured program. 


Then an n-way restructuring of P is defined as a partition 


Tl ={M,, M,,..., Mn) where M1 has the following properties: 


a. ut, Ti =Q, Min lj = ¢ for all i # j. 
b. £ |Sk| < N for al! Mi, l<i«n. 
S, «Mi ae 


Thus, we see that a partition, IT , specifies the set of relocatable 
sectors grouped into each logical page. We will assume that the set of 
sectors in mn, are loaded one after another into logical page 1, then 
the set of sectors in nz are foaded one after another into logical 
page 2, etc., until all the sectors are loaded in the logical address 
span of the program. If |Sk]<N, then there will be a hole or 
S,el1i 

a non-referenced area in the top of page i. 

Therefore, given any partition, Il , of the relocatable sectors into 


logical pages and any sector trace, we can compute the page trace 
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immediately. For example, let S' be the sector referenced at time t- 
in the sector trace and let S'ell j, then the page, p', referenced at 


time t is j. 


From the above: discussion, we observe that -- given any two-level 
virtual memory system V, with page size N, with primary memory size of 
IMp| page frames, with any valid page fetch algorithm Fa, and with any 
valid page removal algorithm Ra-- we have the value of the: page fetch 
function FFp. This FFp is for a program whose structure is mode tad by 
any nantitians lla, and whose reference behavior is modeled by a sector 
trace ST. FFp can be uniquely defined in teres of the following 
parameters: 


FFp=FFp({Mp|,N,. fa,ST,Fa,Ra}. 


For a particular virtual memory system, Y, the values of Mp}, N, 
Fa,Ra are fixed, and a given reference behavior fines the value of ST. 
Under these conditions, the vatue of FFp tiecones a function of the 
different partitions of relocatable sectors into pages. However, as 
pointed out in Chapter 1, the number of different partitions becomes 
astronomical for many: typical programs. For example, phase 1 of the AED 
compiler has 187° different partitions. For such programs it is 
impossible from any practical point-of-view to determine the best 
program structure (the II that minimizes FFp) for a given reference 


behavior by trying out all partitions. 
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From our discussion in Chapter 1, we know that for a given sector 
trace, a partition [I which groups sectors into pages such that the 
number of intersector references between pages of the partition is 
minimized may not minimize FFp. In fact, we presented a quite. plausible 
sector trace where such a [1 would indeed be a very bad partition. One 
major goal of this thesis is to find some way of computing the minimum 
value of FFp over al! partitions. 

it doper and lower bounds on the value of FFp over all partitions 
can be found, then a particular program structure could be evaluated as 
good or bad. Furthermore, those bounds would provide a waane of 
evaluating the ability of practical clustering procedures to produce a 


good program structure. 


The practical drawback of the model developed for the page fetch 
function, FFp, is that sectors are not allowed to cross page boundaries. 
Even though this may not be a serious drawback, we will eventually try 
to extend the model of FFp to take into account the case when sectors 


may cross page boundaries. im 


Se 


2.6 Sector Fetch Function Performance Model - 


We will now define a measure on the information transfer between 
the tuo levels of a virtual menory sisten which is independent of the 
sectie ordering. In the next section, we wifl euploy this measure to 
find theoretical upper and tower bounds on the vatue of the page fetch 


function over ali sector partitions. 


If we assume that the basic unit of information transfer betueen 
the two levels of a virtual mewory iaten Vv’ is a sector instead of a 
page, we can formulate a measure on the inter level. movement of 
information during the execution of a program which is independent of 


its sector ordering. 


‘Let FFs, the number of sector fetches which occur in a virtual 
memory system V’. during the processing of a sector trace ST, be defined 
as the sector fetch function. The processing of a sector trace in V’ is 
called sectoring and can be interpreted similarly to the processing of a 
page trace or paging in V as previously discussed. 

Since the virtual memory system, Vv’, for sectoring is to be 
modified slightly from the virtual memory system, V, used tn’ our 
discussion of paging, we need to define the notion of sectoring more 


precisely. 
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The parameters of a demand sectored virtual memory system, V’, are 


defined as follows: 


1. 


2e 


3. 


4. 


IMs] is called the size of the primary memory, Ms. 

|Ms| is the number of sector frames in the primary memory. 

The size of these sector frames, say in bytes, need not be the 
same. Instead we assume that the size of a sector frame in 
bytes is exactly equal to the size in bytes of the sector it 
contains. Thus, the size in bytes of any sector frame and of 
Ms can vary with time if the sector sizes are different, but 
the important fact is that the number of sector frames in Ms 
is fixed and equal to [Ms]. In contrast, we should point out 
that the size, [Mp], of the primary pwnodu: Mp, for a paged. 
virtual memory system, V, was defined to be the number of page 


frames of fixed size N in the primary memory Mp. 


st = S',S?,...,S5' is a sector trace of a 
program. 

Fa = #4,*%,...,f4 is the demand sector 
fetch policy of V’. 

R = a ee is the sector removal 


policy of Y’. 


Let Ms' denote the set of sectors in primary memory at time t and 


{Ms' | denote the cardinality of this set. 
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Now, demand sectoring and the value of the sector fetch function, 
‘FFs, is defined as follons: 
| a. If Ste Mat! , then ft, =e rte ry 
‘and Ms! = Mst! 
b. If Ste Mst! and [Mst] < [Ms], then 
fy =tS'}, rt= ¢@ and 
Mgt = Mat! + ist} 
c. If Ste Mst! and [Mst} = [Ms], then 
f= ist), r'= {S} and 
Ms'= Mst' + ist} - {S} where 
Sc ns! , and S is selected in accordance 
with the removal algorithm. 


d. FFs = 2b, |¢) I. 


The value of the sector fetch function FFs, for any sector trace, 
ST, can be uniquely determined by simulating algorithm Fd and R for a 


primary memory of size |Ms| at each step of the sector trace. 


Therefore, we define 


FFa = FFs(|Ms{,ST,Fd,R). 


It should be clear that the value of FFs will be the same for any 
sector ordering, since the sector trace is independent of the sector 
ordering. It should also be ciear, from the definition of [Ms] and 
parts a. and b. of the definition of denane sectoring, that the value of 


FFs for a given sector trace is independent of the sector sizes. We do 
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not need to be concerned with the implementation problems associated 
with the variable sector frame sizes of V’, since we will be using the 
sector fetch function only as an analytic tool, and since we can 
determine the value of FFs through simulation without even knouning the 


sector sizes. 


In the next Chapter, the sector fetch function, FFs, will be 
utilized to provide upper and lower bounds for the page fetch function, 


FFp. 


This empty page was substituted for a 
blank page tn the original document. 
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CHAPTER 3 


PAGING PERFORMANCE BOUNDS 


3.1 Introduction 


In this chapter, we will investigate the effect of a program’s 
structure on its paging performance in a ie tunl memory system. We will 
begin by presenting theoretica! upper and lower bounds on the value of 
_the page fetch function, FFp(|Mp[,N, Ma,ST,F,R), over alf partitions, 

Ila, of relocatable sectors into logical pages fo fixed values of the 


other parameters. 


Recall that the value of the page fetch fonction; 
FFp(|Mp|,N, I,ST,F,R), is the number of page fetches a program would 
experience in a two-level virtual memory system, V, with primary memory 
size of |Mp| page frames of size N, using the page fetch and removal 
algorithms, F and R, respectively, for a given sector trace, ST, and 
program structure, [I]. We would like to present a uniform method that 
would bound the value of the page fetch function, FFp, over all 
partitions, [a, of relocatable sectors into logical pages for “any” fixed 
values of the remaining parameters. The merit of such a uni form bounding 


method would be two-fold. First, it would be applicable to any tuo-level 


SS 


virtual memory: system, V, that is, any values of {Mp|, N, F, and R. 
Second, it would be applicable for any. program behavior characterized by 


a sector trace. 


In contrast to a uniform approach, a paced approach would be to 
bound the value of FFp over all partitions when certain or all of the 
‘remaining parameters are constrained. For example, we could assume that 
[Mp| = 1, F = demand fetch, R = FIFO replacement and ST = any fixed 
sector trace, and then derive bounds: on FFp over ail Ma. Clearly, the 
disadvantage of the second approach: is that ie ceul@ nove quite limited 
applications. However, one advantage of the second: approach is that the 
additional knowledge gained by. fixing certain paraua tics of the virtual 
memory system could permit the utitization of bounding methods which 
would result in tighter bounds. We will investigate both approaches in 
this chapter. We have the conviction that a uniform approach over all 
virtual memory syeten jepanatede:aed ais sector traces is vital tor 
general applicability. However, given a uniform bounding eatned: it 
would certainly be worthwhile to investigate the possibility of obtaining 
tighter bounds when feasible constraints on certain parameters of the 


virtual memory system are: speci fied. 


We begin by imposing constraints upon the structure of the program, 
that is, on the partitions, 11, of refocatable sectors into pages, and 


then gradually remove these constraints. 
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3.2 Lower Bounds 


Let us constrain the structure of a program such that each logical 


page contains at most k sectors. In particular, lets 


1. Program = {S, ,S,,...,5,} be a finite set of 
m relocatable sectors such that |5; | < N for 8 < i < m; that 
is, the sector size in bytes is less than the page size, N, in 
bytes; otherwise, the sector size may vary. 

2. Na= {,, Mp ,..., H,} be any partition of 
the m relocatable sectors into n logical pages where the number 


of sectors | 1;| in page j satisfies the constraint 


1<{H] <k. 


3. Recall from our definition of Il that 


z |S; | < N must always be true. 
Sj ell; 


Thus, we are currently concerned with all the partitions, [a, which 
restructure a program such that each logical page has k or fewer sectors. 
The sector sizes may vary, but the ach of the sector sizes grouped into a 
page must not exceed the page size. With this rather flexible constraint 
on the allowable partitions, we can find a lower bound for the value of 
the page fetch function, FFp, over all such partitions for a given sector 
trace and any virtual memory system. We present this lower bound in 


Theorem 1. 
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Theorem 1 

Given any two-level virtual memory system V, with page size N, 
primary memory size [Mp|, and dey: valid page replacement algorithm Ra, 
any valid page fetch algorithm Fa, and any sector trace STa, then, for 
-any partition Ila, of relocatable sectors into logical pages of the 
program where each page contains at most k sectors, the minimum number of 
page fetches given by the page fetch function modet, FFp. has a lower. 
bound given by: . . 
k#FFp(|Mp|,N, Ma,STa,Fa,Ra) > FFs ({Ms{ = [Mpiak,ST = STa,Fd,Ro) 
where the value of the sector fetch function, FFs, is the number of 
sector fetches which otcur in a two-level virtuel wewory system V’, with 
primary memory size |Ms{ « [Mp] #k, the sane sector trace Ta, denand 


fetch Fd, and optisaum replacement Ro. 


Corollary la 
The size of Mp in bytes is equal to. the size of Ms in bytes if each 


page is completely filled with exactly k sectors of the same size. 


Proof of Theorem 1 


Notation and properties 


{ 


Let STa = x! ,~?,...,x' where x' is the sector referenced at 


time t. For virtual mewory system V and FFp lets ; 
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1. Mla=tM,, My ,..., M,} be any 
partition of sectors into the n logical pages of the program 
where each page contains at most k sectors. (This 
interpretation of a partition will be useful later in this 
thesis.) 

2. P - p',p?,...,pt be the resultant page 
trace computed uniquely from ST and Ila , such that if 
x'eIlj , then pt = j. 

3. nt be the set of pages in Mp at time t 
and nN = ¢. } 

4. F, = ee ere be any fetch policy 
where fun M'! = @ and [f}| = the number of 
pages in fi and xe [ nts! u fae 

S. R, =r) ,r%,...r$ be any removal policy 
where r! ¢ nts! and x! ¢ r! . 


6. Mm = CM) u fh per} 


Given ie above notation and properties, we will firet prove: 
ieenG 4. | 

For each Fa and Ra there exists a>dewand fetch and removal policy, 
Fd and Rd, for the FFs mode! such that 


‘kaFFp([Mp],N, Ma,STa,Fa,Ra) > FFs(|Ms| = |Mp|*k,ST-STa,Fd,Rd). 


Proof: 
For the FFs model, Fd and Rd will be constructed by forming a 


sequence of valid replacement and fetch policies 


(F, ,R,), (Fy Rp ),-.+,(Fh,Rh) here: 
1. F, = £1 ,#%,---.f4 and ft = u ft - 
the set of sectors making up the set of pages in i for 
L<t<L, where | Uf) |= the number of sectors in the set. 
2. Similarly Ry =e or seer} and , 
r\ = U ri, for 1 < t<t. 
3. F, = Fy = £4,6%,...,¢4 and 
R, = Ry = Yu seebveeurg 6 tor 1<t<L where 
fh art =o if xe mts! fi = x! and 
rye @ if xt mts! and ym! |< [Mefs | 
fh = xt and rh = be My! if x! g ott! | 
and [t'5' | = iMs}; and 
mi = inj! u fhi-rl to satisfy demand 


sectoring. 


For reasons of expediency, the proof of Lemma 4 will be divided into 


two parts, Lemmas 4a and 4b. 


Lemma 4a: . 
If |Ms}| > |{Mpl|, then for (F,,R,) = (Fa,Ra), there exists a 
valid sequence of sector replacement and fetch policies 
(F, »R,), (Fp ,Rp),.-., (Fh,Rh) such that (Fh,Rh)=(Fd,Rd) and 
Zhi 1 Fi | > Fh. fh: where | {Mp{| denotes the maximum number 
of sectors that could ever be found in Mp. (Note that, in 


Lemma 4, |[Mp]| = [Mp[*xk,) 
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A proof similar to Lemma 4a has been givey by [Ml] for pure paging 
systems. However, we need the following proof to make our extensions 


easier to understand. 


Proof of Lemma 4a. 
The procedure for constructing F, and R, from their immediate 
predecessors F,, and R,, in the FF, model for 1 < j <h is: 
STEP 1. 
Choose the smallest t such that fl, and/or rly do 
not satisfy demand sectoring. 


STEP 2. 


Let z’ be the sector i{x'} referenced at time t in the FFs model. 


CASE 1. 
Now suppose that fh. does not satisfy demand sectoring. 
la. 
If t <L and z’e fli. then set ft = {z’}, and 
fis! = ca U (fh, - {z’} ). This construction insures that 
gtel 


j contains the sectors already fetched by the 


FF, model but not fetched by the FF, model (i.e. deferred sector 


fetches). 
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1b. 

If t = L and z’ ¢ fl), then-set fh = tz}. 

Ic. . . 

If t <L and z’y fL,,then set ff = ¢, and fY! = #tlu fL,. Note that 
this allous the reference x! = z! te: proceed because. sector z’c ML, .° z’e 
ML, since z’e Mp! and |Mj| = |Me} for att 1 <j < h, and: since 

IMs} > |IMpi|. The jast fact, {Mel > [iMpi], afloueM,, to hold 
LIMp{ | sectors; therefore we can aluaye. keep a sector in M., until 
the corresponding page is reseved: from:fp-as: shown in CASE 2 below. 
ld. 

If t =L and z’¢ ft , then set ft = ¢@ The reference proceeds 

due to the same argument as given: in-lc. 

In atl subcases of CASE 1 note: thet F; is vatid-since 

tly Mm! for 1 < t <L, that F, satisfies demand sectoring at 


least up through time t, and that Zh, [fff < zh eld. 


CASE 2 
Now suppose that rh does not satisfy. demand: sectoring. 
2a. 


If t <L, and f} = {z’} and [M5 | = (Mel, set 


rt = {b’} for some b’e rh and 


rl 2 lly (rib). Note that since 


yt | = [Ms] and fl « ¢$, then ry * ¢- and the 
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above operations are always defined. Also, note that rl is 


constrained here and in all subcases to contain only the sectors sivdady 
removed in pages by the FF, model but not yet removed by the FF, 

model; therefore, a sector will not be removed from FF, until the 
corresponding page is removed from FF,. This constraint is enforceable 
since the memory size of FFs at each step j, |Mjj = [Ms], satisfies the 
relation |IMj| > [IMp|]| for 1 < j <h. 

2b. 

If t =L and ft = {z'} and (Mi | = [Ms|, then 

rt = {b’l ¢ rt. 

2c. 


If t < L, and f} = @ or Livat l<}Ms|, then set rf = @¢ 


tel tol 


and rj = rj, rh . 
2d. 
If t = L, and ft = @¢ or ptt | < |Ms|, then rt = ¢. 


In all subcases of CASE 2, note that R; is valid since 
ric nt! for 1 < t < L, and that R, satisfies demand 


sectoring at least up through time t. 


A final comment: if it ever occurs that z’e« rhy and 
z’e fhe then simply remove z’ from both. This only reduces the 
value of lft. and it takes care of the case when a page is fetched 
into and replaced from Mp without having all of its sectors referenced. 


‘The above procedure, after being applied at most h times, must terminate 


- 
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with a valid replacement and fetch poticy pair (Ry ,Fy) such that: 
he ha | 2 Shi an 


Hence, Lemma 4a is proved. 


Choosing |Ms| = IMp| wk satisfies Lemma 4a and we immediately get 
Zier HALE 2 Zhao bfyl = FFe(iNs|=iMp| #k,ST,Fd, Rd). 


Lemma 4b. 


zh 1 ff |< kaFFpCiMp|,N, Ma ,STa,Fa,Ral.. 


Proof: 

Thi lth d = Fh dufbb= th bbb luela 2 nfl. 

But futt | / jet | < k, since jut, | is the number of sectors in 
f! and |f! | is the number of pages in f!.- Hence, | - 


vie, del d xs ke 2h, fehl = ke FFptiMp},N,la,STa,Fa,Ra). 
Lemma 4b is proved. 

From Lemmas 4a and 4b, ue immediately get 
kaFFp(€[Mp|,N, Ia ,STa,Fa,Ra) > FFs(|Ms| = [Mp] «k,STa,Fd,Rd), 


and Lemma 4 is proved. 


From Lemma 1 of Chapter 2 , we know that 


FFs(|[Ms| = |Mp| #k,ST,Fd,Rd) > FFe((Ms| = }Mp{ #k,ST,Fd,Ro). 


64 


From Lemma 1 and Lemma 4 we immediately get 
keFF ([Mp|,N, [la,STa,Fa,Ra) > FF, (|Ms} = [Mp] #k,STa,Fd,Ro) 


and Theorem 1 is proved. 


Proof of Corollary 1a. 
The size of Mp in bytes is |[Mp]xN, and the size of Ms in bytes is 


(|Mp| xk) framesx (N/k)bytes/frame = |Mp|«N. 


Now, a few comments about Theorem 1. For any given program behavior 
characterized by a sector trace, Theorem 1 provides a method of computing 
a lower bound on the inprovement in paging performance over al! sector 
partitions into fogical pages, when pages are constrained to have k or 
fewer sectors. The lower bound given by Theorem 1 is valid for any 
virtual memory system. Another beneficial property of Theorem 1 is that 
the lower bound is specified in terms of a stack algorithm. We know that 
Ro is a stack algorithm from Lemma 3. Furthermore, it is well known 
that, for all stack algorithms, the number of page fetches required to 
process a page trace can be computed for all primary memory sizes from 
one simulation run. For a general discussion of the procedure, the 
interested reader should see [M1], and fur a particular discussion of a 
simulation procedure for the optimum replacement algorithm which requires 
only one wade through the page trace, reference is made to [B5). We 
implemented the latter method for the sector fetch function, FFs, and 
from one simulation run through any sector trace we were able to plot 


FFs(|Ms| = [Mp] * k,ST,Fd,Ro)/k as a function of |Mp]. 
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Figure 3 conveys the general shape of this bound. 


FFp 


FFs(|IMs| = |" x k,S1,Fd,Ro) 
k 


/ 


{Mp | 


FIGURE 3. 


Lower Bound on FFp Given by Theorem 1 
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The utility of such a curve as shown in Figure 3 is as follows. 
Theorem 1 states that the number of page fetches given. by the page fetch 
function FFp(|Mp|,N, Ha,ST,Fa,Ra) for the same sector trace cannot be 
reduced below the curve shown in Figure 3 by any reordering of sectors 


into logical pages regardless of the paging algorithms employed. 


Given that we have a procedure for lower bounding the effects of a 
program’s structure on its paging per formance in any virtual memory 
system, an interesting question is, just how tight is this bound for 
popular virtual memory systems? If Fa is constrained to be demand fetch 
and Ra is constrained to be LAU, FIFO or Optimum replacement, then we 
could prove, by example, that the lower. bound on FFp given by Theorem 1 
can be the greatest lower bound for certain sector traces and. only a 
lower bound for others. We will show that it can be the greatest lower 


bound in a following example later in this thesis. 


We will present and discuss empirical results in Chapter 6 which 
illustrate that the bound given by Theorem 1 is indeed rather tight for 
real programs running in a paged virtual memory system using demand fetch 
and LRU replacement. We will not discuss particular empirical results in 
this chapter because we want to relate the results to intersector 
reference models, to clustering procedures and to theoretical bounds at 
the same time. Intersector Reference models will be developed in Chapter 
& and clustering procedures in Chapter 5, and in Chapter 6 we show the 


results of applying these methods to restructure real programs such that 
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the resulting number of page fetches is quite close to the theoretical! 
bound developed in this chapter for most ‘memory sizes and popular paging 


algorithms. 


Now consider restricting the fetch and replacement policies of FFp 
to be demand fetch and LRU replacement. Under this restriction, as we 
replace the optimal sector replacement policy, Ro, of the sector fetch 
function, FFs, by some tess efficient policy such as LRU and hence — 
produce a tighter lower bound on FFp over all partitions? This line of 
logic led to the following question: is it true that 


kaFFp({Mp|,N, Ma,STa,Fd,Riey ) > FFs(iMs| = [Mp] * k,STa,Fd,Rigy )? 


It seems intuitive that the above conjecture would be true even for 
the case where each logical page contained exactly k sectors. Here, the 
sectored memory could contain exactly the sawe number of sectors as the 
paged memory could contain. Futhermore, at most k sector fetches would 
be required to bring into Ms the same information brought into Mp by one 
page fault. One might expect that, for programs having a good structure, 
i.e., all pages contain sectors that are used together, each page fetch 
should produce k sector fetches. Hence, we have divided the value of FFs 
by k in the conjecture. In spite of its intuitive appeal, we can prove 
that the conjecture is not true for all program behavior. In order to 


validate this claim, we present the following Theorem. 
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Therem 2 

For any two-level virtual memory system V, with page size N, primary 
memory size |Mp|, demand fetch Fd, and LRU replacement Ripy, then 
there exists a sector trace ST, and a partition fl of retocatable sectors 
into logical pages where each page contains k sectors, such that 
k#FFp((Mp|,N, M1 ,ST,Fd,Rigy) < FFs({Ms] = [Mp] #k,ST,Fd,Rigy ), 
where the value of the sector fetch function FFs is the number of sector 
fetches which occur in a two-level virtual memory V’, with primary memory 
size |Ms| = [Mp] « k, using demand fetch Fd, LRU replacement Rigy» 


and the same sector trace ST. 


Proof 
Consider the virtual memory system with the parameters: 
IMp| = 3 pages 
k = 3 or each page of size N contains three sectors. 
IMs] = |Mp]| *k = 9 sector frames 
F = demand or Fd | 
R = LRU or Rigy 
Program = labcdefghijk!}, a set of 12 relocatable 

sectors of size N/3. 
ST = (adgjklhiefbc)?. 
|ST] = 24 


KAKA AH KK KAKA KKK HAKKAR KAR KKK KARR KK KERR AAA KARR RAK 


Consider 
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for ST = adgjkthiefbc adgjkthiefbc 


P = ABC DDD CCB BAA ABC ODD CEB BAA 
Fd = ABC 088 688 GAG 280 280.880 -8A8 
Riny = 888 AG2 888 BOB 8eO ABO 880.800 
Mi = ABC BDO CCB BAA ABC DDO CCB BAA 


AB CCC DOC CBB BAB CCC DOC CBB 
A BBB BBD DCC CGA 888 BBD OCC 


(ores | 


FFp = pide If, | = 7 page fetches 


REAR ARERR ER ARTA 


Nou, 
trace. 

ST 

Fd 


fl =labc,def,ghi, jkl} w#here A = abc, B = def, etc. Then 


AKER ARKER ERE 


we compute the number of sector fetches for the same sector 


adgjk thief 


adgjk thief 


kcadg 


boadg 


jk thi efbc 


jkthi efbc 


@8888 O888a dgjk! hiefb cadg 


adgjk Ilhief 
adgj kihie 
adg jkthi 
ad gikth 

a dgjk! 


adg jk 


bcadg 
fbcad 
efbca 
tefbc : 
hiefb 


lhief 


jkihi efbc 


gjkth iefb - 


dgjk! hief 
adgjk thie 
cadgj kthi 


beadg jkih 
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adgj klihie fbcad gjkl - 
adg jklhi efbca dgjk 


ad gjkth iefbc adgj 


FFs = £74, |¢!] = 24 sector faults. 
-. FFp = 7 < FFs/k = 24/3 = 8 QED. 


MAA AA HAKKAR KK KKK KARR AR KKK KKK KARE KAR RRA K AKRAM ERK EK 


It is interesting to observe that, if the above sector trace, 
ST = (adgjklhiefbc)2, consisting of two cycles through the same sector 
reference pattern, were generalized to a sector trace 
ST = (adgikthiefbc)", consisting of n cycles, then FFp = 3+2n and 
FFs = 12n. Hence, FFp is approximately a factor of 2 less than (FFs)/k 
for large n. These last two values of FFp and FFs are easily verified by 


observing that the paging and sectoring simulations of every cycle after 


the first are respectively the same. 


In our empirical studies of the paging behavior of real programs, we 
found instances where 
kaFFp(|Mp|],N, I,ST,Fd, Rigg) < FFs(|Ms| = [Mp] #k,ST,Fd,Rigy). 
These instances occurred for memory sizes |Mp| in the region ot lou 
paging rates under good program structures, i.e., under partitions which 


produced low values for FFp. 
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We point out in passing that other similar attempts to bound FFp for 
certain memory constraints faited. For example, 
kaxFFp(|fp|,N, I ,ST,Fd,Rego) is not louer bounded by 


FFa({Ms| = |Mp| #k,ST,Fd,Rego )- 


The interested reader may verify this by going through the 
simulation in the proof of Theorem 2 with Rego and 


ST = (a def be ghi. jki de), while keeping everything else the same. 


3.3 Upper Bounds 


How large can the value of the page fetch function become. by 
choosing the “worst” program structure, that. is, the program structure 


which results from the partition, I, that maximizes the value of FFp? 


Theorem 3 

Given any two-level virtual memory system V, with page ates N, 
primary memory size |[Mpl, demand fetch Fd, LRU replacenent Riau » and 
any sector trace STa, then for any partition, Ma, of the relocatable 
sectors into logical pages of the pebgr tie: the maximum number of page 
fetches given by the page fetch function FFp is upper bounded by 
FFp(|Mp|.N, Ma,STa,Fd,Rigy) < FFs(|Ms| = [Mp],ST = STa,Fd,Rigy), 
where the value of the sector fetch function, FFs, is the number of 
sector fetches which occur ina two-level virtual memory system V’, with 


primary memory size |[Ms| = |[Mp|, demand fetch Fd, and LRU replacement | 
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Riru» using the same sector trace ST = STa. 


Proof: Let: 
ST = x! ,x?2,...,x' be any sector trace. 
Tl ={ 1,, Ip,.-., M,} be any partition of sectors 
into pages. 
P = p! pe ee be the ae cateanpane trace 
computed from Il, and ST. 
Mt = contents of memory of FFp model at time t. 
mt = contents of memory of FFs model at time t. 
Fp = £1.63 ,.6.,f% = Fy of FFp. 
Rp = cl aes ests = Ripy of.FFp. 
Fo = th ,f% ,...,f = Fy of FFs. 
Rs =r) wre ,... rh = Rigy of FFs. 
Gupwese, at time t in the FFp model, that p'= z, the page 
containing the set of sectors Il, is referenced. Then, at time t in 


‘the FFs model, x'= z’ is the sector referenced, where sector z’ € Il,. 


CASE 1. 

Suppose pie Mp'!. Then fl= ¢. 
If x'e Ms! , then fh= ¢, and [fh] = [fe]. 
If x! ¢ Ms! . then fl = {p'} 9 Ms! | and 


bab d < Teh I. 


CASE 2. 
Suppose p'y Mp! . Then f= {z}, and 
rte {bt c Mp! under LRU. 
I¢ xt ¢ Mt! , tien fle iz}, rh= tol c tpt! under 
LRU, and [fh | = Heft. 
If xte Mat! | then fl = ¢, and ft | > jet |. This 
condition causes a problem. 
We will prove that p'g Mpc! and x'e Met! can never occur 


together. 


Assume x'e Mat! . Let t’ < t, te the largest time, t’, such 
that x" = x!, then pte Mp’. Since p'y Met! then 
there otcurred at feast [fMp| distinct page references to Mp in the 
interval (t-1-t',t-1) none of which were ‘p’. Therefore, these were at 
Jeast |[Ms|=|{Mp| distinct sector references to fis In the interval 
(t-1-t’, t-1) none of which were x! and x'e tts”! put this 
contradicts Re = Rigg. Thus, x'e Mat! i¢ ple mph! . 

Hence, 24, [fh ) < 24, [4] and the Theorem 


is proved. 


Corollary 3a 
FFs (kx [Mp | ,ST,Fd,Ro) /k < FFp(}Mp|,N, MHe,STa,Fd,Riay ) < FFs([Mp|,ST,Fd,R, ) 


Proof: 


Follows immediately from Theorems 1, 3. 
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Theorem 3 provides an upper bound on the value of the page fetch 
function, FFp, over al) partitions, [a, of the relocatable sectors into 
logical pages for virtual memory systems which employ the popular demand 
fetch and LRU removal algorithms. Under what conditions will the upper 
bound given by Theorem 3 be the least upper bound or even a tight upper 


bound? 


Let the interval of time betueen a fetch of any page and the 
sunsaguent removal of that page be called a page lifetime. Now, consider 
a partition, IIc, of sectors into logical pages, such that, during a 
lifetime, of any page, only one of the sectors of that page is 
referenced. However, let this one sector be referenced any number of 
times in a given page lifetime, and let the particular sector which is 
referenced vary from lifetime to lifetime. We will say that such a 


partition satisfies the page lifetime constraint. 


For any partitions which satisfy the page lifetime constraint, itt is 
obvious that Theorem 3 is the least upper bound. This implies that the 
extent to which partitions exist which group sectors together which are 
not used close together in time te: the extent ‘to which Theorem 3 will 


produce a tight bound. 


Since LRU is also a stack algorithm, the values for the upper bound 
given by Theorem 3 can be computed for all memory sizes by one simulation 


of the sectoring activity for FFs(|Ms| = |Mp|,ST,Fd,Ripy). 
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Therefore, by applying Theorems 1 and 3 a graph similar in form to that 
shown in Figure 4 can be obtained. The gap between the two curves 
represents the range of values of the:page fetch function, FFp, over all 
partitions when demand page fetch and LRU page replacement policies are 
employed. For a ac idu ldo eceer anda teud tubes. the value of FFp in 
peideren to the upper and lower bounds can be used to evaluate the 


potential of program restructuring. 


In Chapter 6, ue will present empirical results which show that the 
‘bounds given by Theorem 3 are quite reasonable for several actual 
programs. This implies that real programs can have sector Je cangewents 
which result in a lot of page fetches. In fact we found in our studies 
of real programs that the actual value of the page fetch function can 
vary by a factor of tens for two different orderings of gectors into the 
logical pages. All of these results for real programs are aiven in 
Chapter 6. However, We will now present an example which will show the 


logistics of applying Theorems 1 and 3. 


3.4 Simple Example of Computing Bounds 


We have chosen a very simple, compressed sector trace of a rather 
small program so that (a) we can illustrate the actual computation of the 
upper and lower bounds and (b) we can easily obtain the best and worst 


sector partitions. Note that this example does not represent any of the 
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FFp 


Upper Bound giver. by Theorem 3 


IMp | 


FIGURE 4. 


The Allowable Values of FFp as a Function of IMp| 
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real programs we tested, since in those cases, the minimum number of 
references in any sector trace was over 1/2 million. Even though this 
example does not represent an actual program, it does indicate that, even 
when 2/3 of this program can fit into priwary memory, there is a wide 
‘variation in its paging behavior over sector partitions. It also 
illustrates that there are simple see tah Abacasciinere the bounds given by 
Theorems 1 and 3 are simultaneously the greatest lower bound and the 


smallest upper bound, respectively. 


Example of Results: 
Consider a virtual memory system with parameters: 
Impl = 2. as 
k=3 sectors per page. 
F = demand or Fy. 
R = LRU, or Rigg - 
Program = labcdefghi}, a set of 3 relocatable 
sectors of size N/3. 
ST = aehae hbdgb dgaeh bficf ibeha dgadg. | 
[ST] = 38. 


RARAKRARKAAAARAEER AR AA RAR ARERR IRATE 
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Applying Theorem 1, we compute FFs(|Ms|]=6,ST,Fd,Ro): 
ST = aehae hbdgb dgaeh bficf ibeha dgadg 
Fy = aeh@@ Bbdg@ BBB88 BficB BBBBa dglBB 


88888 BBB88 BEB88 BdgaB BBGGc F188 


a 
r) 
W 


ML = aehae hbdgb dgaeh bficf ibeha dgadg 
aeha ehbdg bdgae hbfic figeh adgad 
aeh aehbd gbdga ehbfi cfibe hadga. 
aehh hhbdg aehbb bcfib ehhhh 
gee eehbd gaehh hhcfi beeee 
aa aaehb dgaee eehcf ibbbb 
Theoretical minimum = 12/3 = 4 page fetches. 


MAMMA AAA A KHAKI KR AKKAKKKRKKAKKKRKAKRRK KARR AKERRKAR 


Applying Theorem 3, ue compute FFs(|Ms]=2,ST,Fd, Riau): 
ST = aehae hbdgb dgaeh bficf ibeha dgadg 
Fy = aehae hbdgb dgaeh bficf ibeha dgadg 
Riru = @Baeh aehbd gbdga ehbfi cfibe hadga 
mt = aehae hbdgb dgaeh bficf ibeha dgadg 
aeha ehbdg bdgae hbfic fibeh adgad 
Theoretical maximum = 38 page fetches. 


RK AKAMK KAA KAKA KK KAKA KM KKK KAKA KKK KKK ARK EKER 


There are: gt = 288 distinct ways of 
(31)97 (97/3)! 


reordering the 9 relocatable sectors into 3 pages. 


WHA KK AAA KAA KAKA KAKA KKK KKK RAK KAKA KKAAA KK KAKAKKE KKK ERK 
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Consider fl, = fabc def ghi! where page A = abc , etc. 
Now we compute FFp(|Mp| = 2, 1, .ST,Fd, Ary) 


For ST = (aehae hbdgb dgaeh bficf ibeha dgadg), we get 


P = ABCAB CABCA BCABC ABCAB CABCA ‘BCABC 
Fy = ABCAB CABCA BCABC ABCAB CABCA BEABC 
Riry = 88ABC ABCAB CABCA BCABC ABCAB CABCA 
mt = ABCAB CABCA BCABC ABCAS CABCA BCABC 

ABCA BCABC ABCAB CABCA BCABC ABCAB 


FFp = st teh] = 38 page fetches for fl, = theoretical 
maximum. | 


, RRKKKKKAKRARARARRARR RRR AERRERERERRERRERRERRERRERRERRRER ERE 


Consider fl, = {dag beh cfil, where page A = dag ,- etc. 
Now we compute FFp(|Mp| = 2, MH, ,ST,Fd,Aipy). 


For ST = (aehae hbdgb dgaeh bficf ibeha dgadg), we get 


P = ABBAB BBAAB AAABB BCCCC CBBBA AAAAA 
F = ABQ eBge8 BBBB8 BCeBB BeBBA BEed 
R = 98868 BBe88 BREE BAGRE BEBeC BEEse 
Mi = ABBAB BBAAB AAABB BCCCC CBBBA AAAAA 

AABA AABBA BBBAA ABBBB BCCCB BBBBB 


FFp = re, ie l= 4 page fetches for II, = theoretical 
minimum. 


FEIT IORI IIR KARA ERR AR III EE 


In the above example, the theoretical minimum value of FF, = 4 
from Theorem 1 and the theoretical maximum value of FF, = 38 from 
Theorem 3 were found to be the greatest lower bound and the smallest 


upper bound respectively over al! partitions, [1 . 


3.5 Extensions to Lower Bounds 


In section 3.2, lower bounds were derived for the case where each 
page contained at most k sectors. In this section, we would like to 


relax this constraint. 


What were the problems associated with the constraint that pages of 
a partition must contain at most k sectors? There are no problems when 
the sectors are all the same size. However, when the sizes of the 
sectors vary considerably, it becomes more complex to determine the best 
k. For example, if one chooses k to be, the maximum number of sectors 
which could fit into any page, then the set of all partitions are 
allowable, but the value of 


FFs({Ms|=[Mp| *k,ST,Fd,Ro) 
k 


$l 


might not produce a bound which is as tight as ue can produce. This is 
due to two reasons. First, since [Ms|={Mp| *« k, the size of Ms might be 
larger than necessary to aluays hold the sectore present in pages of Mp. 
Note that some pages of Mp might hold fewer than k sectors and that FFs 
is a monotonically decreasing function of [Ms]. Second, perhaps we can 


reduce the divisor k uhen some pages sust contain fewer than k sectors. 


On the other hand, if one chooses k to be some vatue less than. the 
maximum number of sectors which could fit into a page, then some of the 


partitions are not considered. 


We will now consider al! partitions peloceven:© sectors into 
pages. The onty constraint is as before, 

= «ISjl < N for all i, which simply 

S, ell, 
states that the size of any block of the partition in bytes must be less 
than the page size, N, in bytes. Note that this set of all partitions is 
the same as the set of partitions shen k ts chosen equal to the maximum 
number of sectors which could eres fit Into a page. However, we 


will find tighter bounds. 


Consider a program which consists of = relocatable sectors of 
various sizes. We define the "sector size vector”, SS, to be a sequence 
of sizes of these m sectors, SS = [S, ],|S2|.-..,fSm}, such that 


ISi] < |Sjl for all i <j, 1 < j, tem, where |Si{ is the size of Si in 
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bytes. Recall that: 


|Mp| is the number of page frames in the 
paged memory, Mp. 


N is the page frame size in bytes. 


Now we define a function, f,, in terms of [Mp], N, and SS: 
f, ([Mp|,N,SS) = the maximum number of sectors of sizes in SS which can 
be packed into a set of |Mp] page frames of size N bytes each, when 


sectors are not allowed to cross page boundaries. 


Example. 
Let: 
IS; | = |So1 = [Sg] = 1888 bytes; |Sq| = 2888 bytes; 
ISg | = 1S, { = 38868 bytes. 
N = 4888 bytes 
then, 
f, (1,N,SS) = 3 
f, (2,N,SS) = 5 
f, (3,N,SS) = 6 


Since the computation of f, can become a complex combinatorial 
problem in itself, we will give an easy method of computing an upper 


bound for f,. 


The function: FY is defined in terms of IMp|,.N,SS as follows. 
f& ([Mp|,N,SS) = W if and only if 
Z%, 1Si] > IMplaN and 2%) [Si] < IMpl aN. 
It should be clear that ; ([Mp{.N,SS) < fi ¢ipt.N,SS) for all 
[Np]|.N,SS. For the above example, 

f% (1,N,S) = 4 

f (2,N,S) «5 

% (3,N,S) = 6. 


Let us interpret a particular form of fi3 that is, if [Mp] = 2; 
then f, (2,N,SS) is by definition the maximum number of sectors which 


can be packed into 2 page frames of N bytes each. 


We can use f, ({Mp|,N,SS), f, (2,N,SS) and the sector fetch 


function, FFs, to lower bound the page fetch function, FFp, as follows: 


Theorem 4. 

Given any two-level virtual memory system V, with page size N, 
primary memory size |[Mp|, any valid page replacement algorithm Ra, demand 
page fetch Fd, and any sector trace STa, then for any partition Ila of the 
relocatable sectors into the logical pages of the program, the minimum 
number of page fetches given by the page feten function FFp is lower 


bounded by 


FFp(|Mp|].N, Ma,STa,Fd,Ra) > (FFs({Ms] = €, (IMpI.N.SS),ST,Fd,Ro)) ~ A, 
retimel at #, ( bids rh 
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where 4 = 2f,; (1,N,SS)-f, (2,N,SS), and 
f, (2,N,5S) 


where the value of the sector fetch function FFs is the number of sector 
fetches which occur in a tno-level virtual memory system V’, with primary 
memory size [Ms] = f, (|Mp|,N,SS), using demand fetch Fd, optimum 
replacement algorithm Ro, and the same sector trace ST = STa. The 


function f, is as previously defined, and SS is the sector size vector. 


Corollary 4a 


FFp({Mp|,N, [a,Sta,Fd,Ra) > (FFs((Ms[ = f, ({Mp{,N,SS),ST,Fd.Ro))-1 
f, (2,N,SS)/2 


Corollary 4b 


FFp({Mp|,N, la,STa,Fd,Ra) > (FFs(jMs{ = W, ,ST,Fd,Ro)-1, 
W, 72 


Where W, equals either f, ({Mp|,N,SS) or f) (|Mp{,N,SS), and Wo 
independently of W, equals either f, (2,N,SS) or f (2,N,SS). 
Corollary 4b says that we can lower bound FFp in terms of the easily 


computed function f). 


Corollary 4c 


FFs([Ms| = [Mp] #k, Ma,STa,Fd,Ro) < FFs({Ms| = £, (Mp|,N,SS),ST,Fd,Ro) 
k f, (2,N,SS)/2 


Corollary 4c states that the bounds given by Theorem 4 may be tighter 
than the bounds given by Theorem 1 where k is the maximum number of 


sectors which can physically fit into a page. 


Proof of Theorem 4 
Notation and properties 
Let ST, = x! x? pene, where x' is the sector referenced 


at time t. For virtual memory system V and FFp, lets 


1. fl, = (,, M, ,..-, H,} be any partition of sectors into 
the n logical pages of the program where each page contains any | 


number of sectors such that 2 [Sj] < N fer 


2. P = (p',p?,...,p') be the resultant page trace computed 
uniquely from ST and Ma, such that, if «'¢ Hj , then p' = j. 
3. Fa~= ¢4,6% ,...,f be the demand fetch policy, where 
fle la and flé mpi! and jet] = 2 or @, the. 
number of pages in ft , Note that we have chosen to denote Fd 
for FFp by Fa to avord notational conflict with the Fd for FFs. 
4. Ra= ry ofa seceery be any removal policy where 
rie Ma and ric Mpt! and Ir! |] = 1 or @, the | 
number of pages in oe 
5S. M be the set of pages in Mp at time t and Ww = 8. 


6. Me= (Mp! u flo-rt. 


First we prove Lemma S. 
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Lemma 5: 
There exists valid demand fetch and removal policies, Fd and Rd, for 


the FFs model such that 


FFp(|Mp|,N, {a,STa,Fd,Ra) > FFs({Ms| = f, (Mpl.N,SS),ST,Fd,Rd)- A, 
f, (2,N,SS)/2 


where A = 2f, (1,N,SS)-f, (2,N,SS) 
f, (2,N,SS) 


Proof: 
For the FFs model, Fd and Rd will be constructed by forming a 
sequence of valid replacement and fetch policies 


(F, .R, ), (Fo ,Ro),-.., (Fh, Rh), where: 


1. F, = £1,8%,...,65 and fh = g(t!) = 
the set of sectors making up the page in ft, for l <t<L. 
2. Similarly Ry = rhrk eee hy and 
ri agri), forl<t<L. 
3. Fh = Fd = £4 ,#3,...,¢4 and 
R, = Ry = is eer for 1 < t < L where 
ft = rt = 8 if x'e my; f} = x' and 
rh =e Bit xt'y Ms! and ms! [<|Msf; 
ft = x' and rt = {bl c nts! if 
x MS) and jMtj! | = [Ms]; and 
my = (Mj! u thi-r§ to satisfy demand 


sectoring. 
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Since |Ms|=f, (|Mp|.N,SS) > | |Mpll, Lemma 4a says that the above 
construction exists such that 
Fis TAT > Eh Uy 


Therefore, we have Fact 1: 


Fact l. 
sh oie > th, ith) = FFe(itel-f, ({Mp].N,SS),ST,Fd, Rd). 


Now, fet’s prove Fact 2. 


Fact 2. ; 
rh oft] < CCF, (2,N,SS)FEp(Mp].N, Ma,STa,Fd,Ral+f, (2,N,SS) «a ))/2 


Proof. 


She PALE = Fh to C= Shy UAT loeA 

since [fi | = 1 iff [g(fl)| > @ and [fl] = 8 iff - 

gt] = 8. | 

Note that [g(fi)| is the number of sectors in the page specified by ft. 


Also, note that 2b., [¢! |-FFp(|Mp|,N, Ia,Sta,Fd,Ra). 
Now fet’s compress Fa = ¢!, , #2 re bs to get 


FL = f2 ,f2 ,...,ft by taking out all the ft = 8. 
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Clearty a pf! |= ae AT and 


rh, otebitotetoi= 24, fetitotetyt= sh, ety. 


Furthermore, note that, under the definition of demand fetch, no two 
successive page fetches can be to the same page. This ig obvious, since 
under demand fetch a page is fetched and is kept in primary memory until 


it has to be removed to make room for another page. 


Therefore no two successive values g(t, ) and g(t!) can 


be the same. 


Now, the sum pa A lig (#t) | is clearly maximized 

-if, for all odd t, Ig(e,') | is equal to the maximum number of 

sectors which can fit in a page, and if, for all even t, Ig(,') | is 
equal to the next maximum number of sectors which can fit in a page. 


Thus, 
L tp gl! "t t v * ’ 
zie | f; |= rey | f, Ilglt, )] < Let I f, If; (2,N,SS) for even L ° and 
2 
L ty. gt 1 t L-1 y ¢°t 'y capa gl 
Zier Cf) 1 = 2h, Uf Tlolf, JI < Oy If, |; (2,N,SS)+] f, Jf, €1,N,SS) 
2 


for odd L’. 
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Note that f, (1,N,SS)=f, (1,N,SS)+6, (2,N,5S)~#, (2,N,5S), and thus 
2 2 


vt, tel <) €(2,N,55) 2b, Je! | +f, (1,N,S5)-£, (2,N,SS) 
2 2 


. for allt L’. 
Hence, ., |f{ | 


< (, (2,N,SS) FFp(Mp|,N, Ha,STa,Fd,Ral+(2¢, (1,N,SS)-#, (2,N,SS))/2 


and Fact 2 is proved. 


From Fact 1 and Fact 2, we have 


FFp((|Mp|,N, Ma,STa,Fd,Ra) > FFel 


This proves Lemma 5. 


Nou, from Lemma 1, we know that, 


FFs(jMs| = f, ((Mp{,N,SS),ST,Fd,Ad) > FFe(}Ms| = £, (|Mp|,N,SS),ST,Fd,Ro) 
Therefore, Theorem 4 follaus immediately. QED. 


Proof of Corollary 4a: 
It follows immediately from the fact that 


@ < 2f, (1,N,SS)-F, (2,N,55) < 1. 
f, (2,N,SS) 


38 


Proof of corollary 4b: 
Coroltary 4b follows directly from Theorem 4 and Lemmas 2, 3. 
Lemmas 2, 3 give, 
FFs(|Ms|=f, ({Mp},N,SS),ST,Fd,Ro) > FFs(|Msj=W, ,ST,Fd,Ro) 
since W,> f, (IMp|,N,SS). The divisor goes through since 


Wo > f, (2,N,SS). 


‘Proof of corollary 4c: 
Corollary 4c follous from Lemmas 2, 3 since 


[Mp| #k > £, ([Mp],N,SS), and k > f, (2,N,SS)/2. 


To compute the lower bound of Theorem 4, simply make one sector 
simulation run through the sector trace and record the number of sector 
fetches for each possible sector memory size. Then for a particular 
value of |Mp], use f, ({Mp|,N,SS) to select the proper value of FFs and 


divide by f, (2,N,SS) to get the bound. 


If the objective is to lower bound FFp over al! partitions, then 
Theorem 4 may give tighter bounds than Theorem 1 if the range of sector 
sizes is large. For this is the case when f, (|Mp|,N,SS) < ke [Mp]. 
Furthermore, f, ({Mp|,N,SS) can become substantially less than kx [Mp] 
for large values cf |Mp|. The term, f, (2,N,5S)/2, in the lower bound 
is the average value of k for the two pages having the largest number of 
sectors. We cannot extend this average over all pages, gince every other 


page fetch could be to the page containing the largest number of sectors, 
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while every intervening fetch could be to the page having the second 
largest number of sectors. Even if al! pages are fetched, if the above 
behavior occurs sufficiently often in the execution of a program, then we 


still cannot average over all pages. 


Is there any way to compensate for the case when some sectors are 
much larger than others? For ease in the following discussion, fet the 
average vaue of k for the two pages having the largest number of sectors, 
f, (2,N,SS)/2, be denoted by k’, and fet the average size of these 
sectors be denoted by N/K? In order to illustrate some typical values 
one may encounter, we point out that for the real programs ue 
investigated, the values of k’ were on the order of 3 to 6, and, hence, 
N/k’ was 1/3 to 1/6 of a page for a page size of 4896 bytes. Now let’s 
assume that we are given a particular program, Q, and we compute the 
value of N/k’ and find that there are several sectors whose sizes are 
considerably targer than N/k’. Now consider what happens if we break up 
these large sectors into as many wiiseetare cas we can without increasing 
the value of k*. This new program with the targe sectors replaced by the 
smaller subsectors is called Q*. Given Q*, it is still quite easy to 
compute a sector trace over Q* from the address trace. We call such a 
sector trace ST*. Using this sector trace, ST*, and the program, 

Q*, we can apply Theorem 4 to compute the lower bound on the page fetch 
function, FFp, over all partitions, M[a*, of sectors of QO’ into 


logical pages. We present two important observations on this lower 


bound: 
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A). This lower bound is valid over all partitions of sectors of 
Q’ into pages. Therefore, the lower bound is certainly true for all 
the partitions over Q* that are constrained to comply with Q. That is, 
if a page in a partition of Q* contained one subsector of a sector, 
then it would have to contain all the subsectors of that sector. This 
restriction on the set of all dati tions over ar simply produces the 
set of partitions which result when reprogramming is not allowed. 


Let Ilar* denote any such restricted partitions of Q. 


B). This lower bound using ST* and Mar* over Q* is probably 
much farger for most real programs than the flower bound couputed by 
Theorem 4 using ST and fla over Q@. The rationale for thie simply that 
it will take several subsector fetches to bring into the sectored memory 


the same information that could be fetched by one large-sector fetch. 


Observation B need not necessarily be true; that is, the lower 
bound which results from breaking up the large sectors could — 
theoretically be smaller than the lower bound computed by not breaking up 
the lfarge sectors. However, this presents no practical problems. Since 
both methods wil! produce valid Jower bounds, we simply compute both and 
use the greater lower bound. In our analysis of real programs, we found 
that the lower bound computed from breaking up the large sectors was 
substantially larger than the lower bound computed when the large sectors 


were not divided. 
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We will now formalize the notions of O* and ST* and define the 
relationship between ( and O° and between ST and ST*. Then, Theorem 
S is presented, which states that the page fetch. function, FFp, is lower 


bounded in terms of the sectoring behavior given by ST*. 


Let, Q = Q, U Q2={set of m relocatable sectors of any program) 
uhere Q, ={S, So veceee Sh}, Op = tS), Sp eee Seed 
euch that f; (2,N,SS)/2 = k/Z and [Si] < |Sj] for all Sie Q, and 
Sj « Q. 
Let, SS = [ry Jo Irole-ces dre de drkeile--oo ttm | be the sector 
size vector of 0; that is, rje Q and Ir; | < Ir) | for i < j and 
Itml < N, the page size. j a 
Note that |r, | is the size of the largest sector in Q,. 


Furthermore, note that the above construction is always possible. 


Now, we break up the large sectors of @ into subsectors. Let 


Si = (Sii*} for 1 < i < k and 


Si = {Si} ,Si5 reee Sil } for k<i < m such that 
' 


Ir, ts 1Sij* |. 

This last constraint is sufficient to guarantee that 

(f, (2,N,SS))/2. = k/2 does not change because of the smal subsectors. 
In practice, one could choose [Si j* | = Ir, | for l < j< lj and 


Ire ls ISii*] < Zin lt for j = |. 
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Now define, Q*= Q} U Q3= {set of m’ relocatable sectors 
of the same program) 
where Q) ={S},, S52,---Sy, } and 


Q3 = {Skat » Skei,2 yeeee Ske rece Smt »Siy2 pee Sm }. 
ke] m 


Let, SS* = {ri |,ira]..--,[rt, | be the sector size vector 
of a’, |r? |< Irj | for i < j. 


Note that (f, (2,N,SS))/2=(f, (2,N,SS*))/2. 


Given any address trace, A, and the sector ordering of the programs 
Q and Q* for that address trace, we can easily compute: 
st = S',s?,...,S' for O and ST*= S*,S*,,..,S" for Q*, where 
ste Q and Ste at. | 
Note that, if S* = Sij* then S'= Si for 1 <t<L. 
Thus, We can also compute ST from ST*. 
Theorem S is presented in terms of the above definitions of Q* and 


sT*. 


Theorem 5S. 
Given any two-level virtual memory system V, with page size N, 
primary memory size |Mp|, any valid page replacement algorithm Ra, 


demand page fetch Fd, and any sector trace STa, then for any partition, 
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Ila, of the relocatable sectors into the logical pages of the program, Q, 
the minimum number of page fetches given by the page fetch function, 


FFp, is lower bounded by 


FFp({Mp|,N,fMa,STa,Fd,Ra) > FFs((Ms{ = f, ({Mpi,N,SS*),ST = STa*,Fd.Ro)- A, 
f, (2,N,SS)/2 


where A = 2f, (1,N,SS) - £, (2,N,S5), 
f, (2,N,SS) 


and where the value of the sector fetch function FFs is the number of 
sector fetches which occur in a two-level virtual memory system V’, with 
primary memory size |Ms| = f, (|Mp],N,SS*), using demand fetch Fd, 
optimum replacement algorithm Ro, and sector trace ST = STa*. The 
function f, is previously defined, SS is the sector size vector of Q, 


and SS* is the sector size vector of Q*. 


Proof: 
Let Q, ST, Q* and ST* be exactly as defined immediately before 
Theorem S was stated. . 
Let [a*= (TT, M%,..., HM} } be any partition of the 
relocatable sectors of Q* into logical pages, where page k = [ly 


for 1 <k<nand & ISij* | < N. 
Sie Ty 


Apptying Theorem 4 to Q* gives by simple substitution, 


FFp(|Mp|,N, Mat ,ST* ,Fd,Ra) > FFs({Ms| = f, ({Mp|,N,SS*),ST*,Fd,Ro)-a, 
f, (2,N,SS*)/2 


and since f, (2,N,SS*)/2 = f, (2,N,SS)/2 ue get 


FFp(|Mp|,N, Mla,ST*,Fd,Ra) > FFs{{Ms| = f, ([Mp|,N,SS*),ST* ,Fd, Ro) -a. 
f, (2,N,SS)/2 


Let Ma = tM,, M2,..., Hn} be any partition of relocatable sectors 


of Q into logical pages such that 2 [Si] < N and Si ¢« Q, 
: S, ell, 


where page k = IIlk for 1 <k <n. 

Given any [la, then we construct Tlar* as fol lows: 
Mar*= {fir}, Ur3,..., Urs } such that, 

for all Si e Ilk, Sij*e« Irk* 


for 1 < k < |, and page k = IIrk* for l ck <n. 


Now, 


FFp(|Mp|.N,lar* ,ST*,fd,Ra) > FFa(jMs] = €, (Mpl,N,SS"),ST* ,Fd,Ro)- A, 
f; (2,N,SS)/2 


since the set of all Mar* is a subset of the set of all Ma*. 


Now we prove that 


FFp(|Mp|,N, Mar* ,ST*,Fd,Ra) = FFp(|Mp|,N, Ma,ST,Fd,Ra) 


We need to show that the page trace 


P* = pe sb ece8be 


» computed from Ilar* and ST*, is the 
same as the page trace P = p!,p*,...,p!, computed from [la and ST. 


Let ST*=S*! ,s*2 ....,5% ana ST=S! ,5?,...,S!. 


Let the sector referenced in ST* at time t be S* for 1 <t<lL, 


Then S* = Sij* for some 1 < i < m’ andl <j < 4;, 
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and Sij*« firk* for some 1 <k <n. Hence, p" =k. 


Given S* = Sij’, then S'= Si, and, given Sijte IIrk*, 


then Si ¢« Tlk. Hence, p'= k, and we have p” - p' for lL < t<L. 


Therefore, 


- FFp(|Mp|,N, Mar" ,ST°,Fd,Ra) = FFp({Mp|,N, Ma,ST,Fd,Ra) and 


FFp(|Mp|,N la,ST,Fd,Ra) > FFst{Ms| = ¢, (Mpl.N.SS°),ST*.Fd,Ra) - a, 
| f, (2,4, 55) /2 


QED. 


The following simple example is given to if/lustrate that Theorem 5 
can produce a tighter bound than Theorem 4. This example is made as 
simple as possible such that the mechanics of applying Theorem S can be 


presented. 


Exampte: 

Let Q = {S, ,So,-..,Sj9 } where |Si] = 1888 bytes for 
1s i < 8, and |Si| = 4888 bytes for 8 <i < 12 and N = 4888 bytes. Now 
let’s divide Si for 8 <i < 12 into four parts, each being 1888 bytes 
long; i.e., Si becomes {Si, ,Siz,Sig,Sig! where | 
|Sij] = 1608 bytes for 1 < j < 4. Thus, 


Q° _ {S| »S2 93 eee » Sg » Sg} ySgze Sage Sgqs > + + 549, 19512.29912.399 912.41 = 
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Let ST‘ = S; +32 »93 yeeeeSBe Sq »Sq2 +593 » S94 peeses S12,1+512,2°912,3% Si24- 


This represents the compressed reference 


behavior of one pass through Q’ where every 


unit of Q' is touched. [t is reasonable to assume that such sector 


behavior could represent one pass through a smal! loop of a much targer 


real program. 


Nou, ST=S, +52 +93 peeese Sg +59 »Sg »Sq ST yee 0991299129942 Sj2- 


Evaluating FFp(|Mp|,N=4888, Ila,ST,Fd,Ra), gives 6 page fetches when 


M, = {S,,S2,53, Sat, Mp= 'S3,S_,,S7,Sg} and 

Thi = {Si+6} for 2 <i < 6, and |[Mp| and Ra take on any values. 
should be clear that this partition minimizes FFp. 
Theorem 4 gives a Jower bound for FFp of 


FFs({Ms{ = f, (Mpl,N,SS),ST,Fd,Ro) - 4 = (12/4)-8 = 3, 
f, (2,N,SS)/2 


for all values of |Msj. Note that f, (2,N,SS) = 8 and 


It 


f, (1,N,SS) = 4, hence A = 8. Theorem S gives a lower bound for FFp 


of FFs(|Ms| = f, ({Mpj,N,SS5*),ST* ,Fd,Ro) - aA = (24/4)-8 = 6, 
f, (2,N, 55) /2 


for all vatues of |Ms|. Thus, Theorem S gives the greater lower bound, 


and it is a factor of 2 better than the bound given by Theorem 4. 
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Now we extend. Theorems 4 and 5 to include the cases where sectors 


can be any size, and we let the sectors cross page boundaries. 


We now present Theorem 6 which lower bounds FFp over al! sector 
orderings SO into the n-page logical address space. The sectors can be 
any size and may cross page boundaries. This model corresponds to the 
case where sectors are clustered together into groups and then these 


groups are packed into the virtual address space. 


Since sectors may cross page boundaries, one may not be able to 
determine the page trace from the sector trace ST. We define SOT to be 
the sector trace consisting of ordered pairs of elements: 

sot = (S',0'),(S?,07),...,(S',0') where S' is the 
sector referenced at time t and O' is the offset in S' referenced at 
time t. Given a sector trace SOT anda sector ordering SO as defined in 


Chapter 2, the page trace follous immediately. 


Note that SOT* is exactly the same as ST* except that the 
elements of SOT* are simply ordered pairs. Also note that the 
construction of Q* is not affected by allowing sectors to cross page 
boundaries. 

Theorem 6. 

Given any two-level virtual memory system V, with page size N, 

primary memory size |Mp|, any valid page replacement algorithm Ra, 


demand page fetch Fd, and any sector trace SOTa, then for any sector 
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ordering SOa, of the relocatable sectors into the logical address space 
of the program Q, the minimum number of page fetches given by the page 
fetch function FFp, is lower bounded by | 


A. 


FFp(|Mp|,N,SOa,SOTa,Fd,Ra) > FFs(|Ms| = f4 (jMp|,N,SS), ST = SOTa,Fd,Ro)- & 
#4 (2,N,SS)/2 
and by 


B. 


FFp(|Mp|,N,SOa,SOTa,Fd,Ra) > FFs({Ms| = fy ({Mpj,N,SS°),ST = SOTa* ,Fd,Ro)- A 
#4 (2,N,SS)/2 


where A = 2f% (1,N,5S)-f5 (2,N,SS), 

#4 (2,N,SS) 
and where the value of the sector fetch function FFs is the number of 
sector fetches which occur in a two-level virtual memory system V’, with 
primary size |Ms|, using demand fetch Fd and optimum replacement Ro, and 


sector trace ST = SOTa in part A and ST = SOTa* in part B. 
Proof of Theorem 6; 
Let SoT,= (S' ,0'),(S? ,07),...,(S',0'), where S' is 


the sector referenced at time t and O' is the offset. For virtual 


memory system V and FFp, tet: 
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1. SOa be any sector ordering of the relocatable sectors in the n 
pages of the addrese space of program Q. 

2. P = p! op? seosept be the resultant page trace computed 
uniquely from SOTa and SBa, such that ste (Lis! ) 40°) /N. 

3. Fa= ¢1,62,..., ¢$ be the demand fetch pol fey, where 
fla ip') or @; fin Mpt!.=@. Note that we have 
chosen to denote Fd of the FFp model by Fa to avoid notational 
conflict with the Fd of the FFs model. 

4. Ra «=r!,r2,...,74 be any removal poticy under demand 
fetch, where rt < Mp"! ana {et f= or 8. 


5. Mpt= (Mpt!- ri) ue! and Mp’ @. 


First we prove the foltowing lemma. . 


Lemma 6: 


There exists a valid demand fetch and removal policy, Fd and Rd, 


‘for the FFs mode! such that 


FFp(|Mp|,N,SOa,S0Ta,Fa,Ra) > FFst{Mel = FY CMpl.N.SS) SQTa,Fd,Rd)- A, 
“#4 (2,N,SH/2 


where A = 2f4 (1,N,S)-f% (2,N,SS). 
fY (2,N,SS) 


For the FFs model, Fd and Rd wit! be constructed by forming a valid 
sequence of replacement and fetch policies 


(F, oR, , (F, aRodieoes (F, oPR,), ‘where: 
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1. F,= #),#%,...,64, and t= gltt =the set of 
sectors having any of their parts in ft for l<t<L. 

2. Similarity, R,=r',,r4,..-,r4, and 
ri = gtr!) = the set of sectors having any of their parts in 
r! for l <t<lL. 


3. Fh = td = £4 ,f%,...,f4, and 


+ 
a 
zs 
f] 


Rd = ry ry yeceeth, for l1<t<L, where 
fh= rh= 8, if xte Mtl; fy= x' and 

ry= 8, if xte Mdt! and yma’! [<|Mst; 

fhe x! and rh= tbc Mh! it xte md! and 
[Ma'-! j={Ms}; and Ma’ = (MdtLrl yu. to 


satisfy demand sectoring. 


Lemma 4a is stil! true for this case when sectors may cross page 
boundaries. The proof of Lemma 4a when sectors are allowed to cross 
page boundaries is exactly the game as before except that we add the 


following to the proof. (Recall that z’ is the sector referenced at 


time t.) 


If it ever occurs that z’e fly and z’e Mp’! , then 
simply remove z’ from fli. This only reduces the value of 
jet and it keeps sector z’ from being added to the deferral sector 


list when z’ is in the sectored memory. 
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Since |Ms| = £4 ({Mpt.N,SS) > | fMp]if, Lemma 4a says that the 


above construction exists such that 
Shey ALT > Zh. 16h beFFel|tel~t) (iMp],N,SS),SOT,Fd,Ad) 


Fact 3 


Zhe Vfl |< CA (2,N,SS)FFp(iMp} NSO, SOT, Fd, Ral) + #4.(2,N,SS)e & 
2 2 


The proof of Fact 3 is exactly the same as Fact 2 of theorem 4 
except that Igtet yy becomes the number of sectors having any of 


their parts in fl. 


Hence Lemma 6 is true. Lemna 6 and Lemma 1 prove part A of the 


Theorem. 


Proof of part B. 


Given any address trace A and any Q, construct Q*, SOT, and 
SOT* exactly as in Theorem S, except denote the elements of SOT and 


SOT* as ordered pairs. 


The proof of part B is almost exactly the same as the proof of 


Theorem 5S. We point out the exceptions below. 
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Instead of applying Theorem 4 to Q* as in Theorem 5S, we apply 
part A of Theorem 6 to Q* and use the fact that 


“ (2,N,SS) = £4 (2,N,SS*) to get 


FFp(|Mp|,N,SOa* ,SOT* ,Fd,Ra) > FFs(jMsj=f) (Mp|,N,SS*),SOT* Fd, Ro)- A. 
4 (2,N,SS)/2 

In the proof of Theorem S, we restricted the set of Ila such that 
subsectors could not be in different pages. Here we restrict the set 
SO%{ of all SOa* to get the subset SOjp . Let x « SOA, 
then x ¢ SOse if the subsectors of each sector in x occur together 
as a subsequence of SOar*, and if (hg sUbseetona of each sector are 
ordered in the subsequence as they occur in the sector. We are simply 
restricting the set of all SQa° dich that we get the set of all SOa 
then the common subsectors of each subsequence of each SOar* are 


concatenated together. 


Since the above result, FFp > FFs, is true for all SOa*, it must 
be true for any constrained subset of SOa*. In particular it must be 


true for all SQar*. Thus 


FFp(|Mp|,N,SOar* ,SOT* ,Fd,Ra) > FFs({Ms] = #4 ([Mp|,N,SS*),SOT* ,Fd,Ro)- A 
#4, (2,N,SS) /2 
Now we need to show, as in Theorem 5, that the page trace P* 
computed from SOar* and SOT* is the same as the page trace P 
computed from SOT and SOa. This is obvious from the construction of 


SOQar* and SOT*. That is, P* computed from (s* ,o* ) 
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and SOar* must be the same as P! computed from (s' ,o') and SOa. 
Thus, FFp(|Mp|,N,SOa,SOT,Fd,Ra) = FFp(|Mp|,N,SOar* ,SOT* ,Fd,Ra) 


and the proof of B follows immediately. QED. 
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3.6 Bounds for Working Set Management 


Theorems 1-S give upper and lower bounds on the number of page 
fetches required to execute a program in any fixed primary memory size. 
However, there are paging algorithms which exploit the important program 
property of locality by attempting to dynamically allocate various 
amounts of primary memory space to a program as it executes. Recall 
that, intuitively, locality means that during a given interval of 
execution a program addresses only a subset of total addressable space. 
However, for different intervals, the size of this subset may vary. 

From this notion of locality comes that of “working sets", and a theory 
of primary memory based on this notion has been proposed and extensively 
investigated in (01,02,03]. Therefore, we wil! extend our definition of 


the page fetch function, FFp, to include working set memory management. 


In order to incorporate the page working set concept into the 
methodology we adopted in Chapter 2 for presenting paging algorithms, 
recall the following definitions. Assume that: 

Q= [A,B,..} is a finite set of logical pages. 

P = p',p*,...,p' is a page trace with pte Q. 

Mp'< Q is the contents of Mp at time t. 

F = ¢!,¢7,...,¢¢ is the page fetch policy. 

R =r! ,r2,...,r¢ is the page replacement policy. 

A paging algorithm based on the page working set principle is defined as 


follous. 
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as Wp(8,T) = ¢@ 
b. Mp’ = Wp(t,T) and jMp' | = uplt,T), B< t< Ll 
_c. fi=@ if ple Up(t-1,T) = Mpl', Let cl 

d. fi=p! if pie Mp(t-1,T) = Mp’, P< tcl 

e. r'= Wolt,T)-Wp(t-1,T); note that Ir'}f <1, l< t<bk 
Thus, we see that under a page working set strategy, the contents of 
primary memory at time t, Mp’, is simply the working set, Wp(t,T), and 
that the amount of primary memory allocated to a program expands and 
contracts as the working set size up(t,T) expands and contracts. A page 
reference at time t, p', causes a page fetch into primary memory if 
and only if p is not in the working set at time t-1. Note also that a 
page is removed from primary memory at time t if and only if it is in 
the working set at time t-1 and it is no longer in the working set at 


time t. 


. From the above discussion, we observe that the number of page 
fetches required by a program during its execution using the page 
working set memory management technique is uniquely determined from the 
page trace, P, and the working set parameter, T. Therefore, the 
definition of the page fetch function, FFp, under page working set 
memory management can be expressed as a function of the following 
parameters: 


FFp = FFp((Mi | = uplt,T),N, Ma,STa,Wp(t,T)). 
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The parameters in this definition of FFp for-working sets are 
identical to those previously présented for the page fetch function, 
FFp, except for two instances. The first parameter, which denotes the 
primary memory size, is equated to wp(t,T) to ilfustrate that the size 
of Mp varies with the size of working set. The other instance is 
strictly notational, i.e., we have replaced the fetch and replacement 
parameters, F and R, with Wpl(t,T) to illustrate that the F and R 
policies are those defined for working set memory management. We could 


have used Fu and Ru, but we think that Wp(t,T) is simply clearer. 


We can also extend the definition of the sector fetch function, 
FFs, such that it denotes the number of sector fetches which occur in a 


virtual memory system during the processing of a sector trace under 


sector working set memory management. 


Consider a program whose behavior is modeled by a sector trace, ST. 
Then the sector working set at time t, Ws(t,7T), is defined to be the 
distinct set of sectors referenced in the sector trace, ST, during the 
time iateeval (t-T, 1). The number of sectors in the sector working set 
at time t is defined to be the sector working set size and is denoted by 
ws(t,T). The maximum value of the sector working set size for a given 
sector trace is denoted us(t,T)max. Note that ws(t,T)max < T. Lets 

a. Program = fa,b,..}, a finite set of relocatable sectors. 

bp. ST = 5! ,S?,...,5', a sector trace with she Program. 


Cc. Mc Program, the set of sectors in primary memory 
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at time t. 
d. F = ¢!,¢7,...,6, the sector fetch policy. 


e. Re=r!',r?,...,.0¢ , the secter replecersnt policy. 


Then the sector behavior of a program using sector working set memory 
management is defined as: 

a. Ws{8,T) = % 

b. Ms'= Welt,T) and ffte! | = welt, T), 8< t <b 

c. fla @ if She Us(t-1,7) = teh!, 1c tcl 

d. f'= St if She Ms(t-1,T) =e’, 1c t cL. 

e. ria Welt, T)-Wstt-1,T), @< t < re 


Thus, the contents of prisary memory at time ‘t ta the sector sorking set 
at time t, Ws(t,T), and a sector reference at the t causes a sector 
fetch if and only if S'e Us(t-1,T). Note that the set of sectors that 
are generated by the sector working set strategy to‘be in primary memory 
at time t is Us(t,T), no matter what the sizes of the individual sectore 


are. 


The sector fetch function, FFs, for ‘the sector uorking set strategy 
: becanes: 

FFs = FFa((te! | = uolt,1),ST»Melt,7)), 
We observe, as before, that the value of the sector fetch function, FFs, 
which is the number of sector fetches required to process a sector 


trace, is uniquely determined by the ST and the Nef{t,T) parameters. 
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The notion of Sharacterlcing the local behavior of a program in 
terms of its sector working set has two potential applications. The 
first is to utilize the time varing sector working set to identi fy the 
sectors which should be clustered together in order to minimize page 
faults. This application turns out to be very useful and is discussed 
in full detail in Chapter 4. The second is to find upper and lower 
bounds on the paging behavior, FFp, of programs using the page working 
set strategy in terms of the sector behavior, FFe, using sector working 
set memory management. This approach proves successful for the upper 
bounds but fails for the lower bounds. Even though the approach fails 
to produce lower bounds, Part A of the following theorem points out an 
interesting relationship that can exist between the number of page 
fetches and the number of sector fetches for programs using working set 


memory management. 


3.6.1 Lower Bounds for Working Set Management 


Recall that welt, T)max is defined to be the maximum value of the 


‘sector working set size for a given sector trace.. 


Theorem 7 
Given any two-level virtual memory system V, with page size N, 
primary memory size [Mp'| = up(t,T), using paged working set memory 


management Wp(t,T), and sector trace STa, then for any partition, la, of 
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the relocatable sectors into logical pages of the program where each 


page contains k or fewer sectors, the minimum number of page fetches, 


given by FFp(|Mp' | «= wp ft, T),N, fia, STa,Wp(t,T)), 


A. is not lower bounded by 


FFa({Ms' | = uslt,k, T),ST = STa,Welt,k, T)) and 
(xx ko 


B. is not lower bounded by FFs({its| = kx T,ST=STa,Fd,Ripy) but 
C. is lower bounded by FFa([Ms| = k# uelt,T)max,ST = STa,Fd,Ro), 
= ! 


where the value of the sector fetch function, FFs, is the number of 
sector fetches which occur in a two-level virtual menory system V’, with 
primary memory size [Ms], with the same sector trace ST=STa, using 
sector working set management in Part A, using demand fetch, LRU 7 
replacement in Part B and using demand fetch, optimum replacement in 
Part C. The value of k, and ky are any arbitrarily large integers 
greater than 1. (The value of f, is as previously defined, and SS is 
the sector size vector.) The value of ws(t,Timax is the maximum value 


of we(t,T) over ST. 


Part A of the above theorem states that there are sector traces 
such that the number of sector fetches required to process the sector 


trace is arbitrarify larger than the number of. page fetches required to 
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process the corresponding page trace under a good sector ordering. 
Moreover, it states that this is even true when the window size of the 
sector working set is made arbitrarily large and the resulting number of 
sector fetches divided by an arbitrarily large constant. We claim that 
this is counter-intuitive, because a) if the sector working set window 
size were simply kT, then the sector working set could contain the same 
number of sectors as those contained in a page working set of size Ts; 
and b) dividing FFs by k alone would account for the fact that as many 
as k sector fetches are required to bring a page of information into 


primary memory. 


Proof of Part A: 


We need to show that there exists a set of parameters such that 


FFp({Mp'| = up(t,T),N, M,ST,W, (t,T)) < FFe([Ms' | = ust, k, T),ST, Walt, ky T)) 


k ® ko 


Let: 


Ts2 

k, ko = any fixed arbitrarily Jarge integers. 

m> k,T 

n> k ® ko 

k=2 

Program = (abxy), a set of 4 relocatable sectors 
each of size S, where S = N/k. 

ST = ({ax)™ (by)™)" be the sector trace. 


Il ={lab), (xy)} where page A = {a,b} and page X = {x,y}. 
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P = CCAR (A) = (AND) is the page trace. 
Wp{@,T) = We(8,k, TY = 8. 


a. Now, it is clear from the definition of Mptt,T) and 
Po = (AxX)?™ that | 
FFp(jMp' | = up(t,T),N, MW ,ST,W, (t,T)) = 2 for afl m and n. 
b. Non, to evaluate FFs. | | 
ST = (Cax)™ (by) ")" implies: FFet| Ms! | ~ wuett,k, T),ST, Welt, k) TI) = 4n. 
Proof: 
Part 1. 

Consider the substring prance pattern fax)". Observe that the 
first reference to this substring occurs at times t = 1+4mi. for 
i = O1,...,m - 1. West, &, T) = & by definition. | 
us(t,k, T) = (p,yl for t = leami i = 1,2,...,m = 1. 
This is true because for each of these times, t, the last 2m references 
were to b or y. Since 2m > k,T, only b and y can be in Walt,k, T)s 
and since k,; T > 2, both b and y must be in We(t,k, T). 
Hence, for each of the n occurrences of the substring (ax)™ in the 
sector trace, exactly two sector fetches are required to bring a and x 
into the working set, where they stay while processing the remaining 


references in the substring, since k,T > 2. 
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Part 2. 

Consider the substring reference pattern (by)™. The first 
reference to this substring occurs at times t = l+m(4i-2) for 
i =~ 1,2,..,n. 
The Ws(t,k, T) = fa,»} eer = lem(4i-2), i = 1,2,.+64M, since at each 
of these times, t, the last 2m references were to a or x. Since 
m > k, T, only a and x can be in Ws(t,k, T); and 
since k,; T > 2, both a and x must be in Ws(t,k,; T). 
Thus, for each of the n occurrences of the substring {by)™ in the 
sector trace, two sector fetches are required to bring b and y into 
Ws(t,k, 17), and moreover only two are required since k,T > 2. 
Therefore, FFs{{Ms' | = us(t,k,1T),ST,Ws(t,k, T)) = 4n. 
Non, 
FFs/(k*k2) = 4n/(kxk,) > (4kek,)/kxk, = 4 > FFp = 2 


and this proves part A of Theorem 7. 


What causes this strange behavior in the number of sector fetches? 
Is it true for only strange and rare sector traces or could it be 
expected to occur in many common sector traces? We claim that this 
behavior could occur in many sector traces. In order to provide some 
insight into this claim, consider the sector trace ST = a, a2 a , 
where a2 =((ax)"({by)")" and a,, & represent any long 


sector reference strings. The proof of part A shows that the ratio 
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(FFs/FFp) > kz for the substring do, where kp can be made 
arbitrarily large by choosing n sufficiently large. Therefore, the 
ratio (FFs/FFp) can stil! be wade arti trarity rerge for fixed a, and 
a, by simply making n sufficiently large. A generality of this brief 
argument says that, whet: a secto trace has any substring consisting of 
tight embedded loops, the number of sector fetches may become much 
larger than the corresponding nusber of page fetches. One explanation 
of this phenomenon is as foltows: tight inner loops (i.e., (bx)” )) 
drown out the benefit gained by making the sector window size large 
(i.e., the value of Us(t,T) becomes ths} Pf mw > TI, while the outer loop 
causes the sectors in the itiner toops to be fetched over and over. In 
contrast, the paged vorking set having a small window size, relative to 
m, is able to contain all the sectors in the embedded loops fi.e., fax}, 
{by!) throughout consecutive cycles of the outer.loop, if at least one 


sector from each inner loop is grouped into the sate page. 


From the above discussion, we observe that the page working set can 
contaln~sore of the most recently referenced sectors than the sector 
uorking set, even when the latter has an arbitrarily large window size. 
We can eliminate this condition by redefining the sector working set as 
follows. Recall! that the sector working set, Ws(t,T), has been defined 
to contain the set of distinct sectors referenced in the last T 
references. If ne modified the definition of Ws(t,T) such that it 
contains the set of T most recently referenced sectors, and if we choose 


T to be k times the page working set window size, then the page working 
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set could never contain more of the most recently referenced sectors 

than those contained by this sector working set. However, this new 
definition of the sector working set is equivalent to demand fetch, LRU 
replacement in a memory of fixed size equal to k times the Sue working 
set window size. Thus, a plausible conjecture is that the number of 

page fetches under a page working set strategy could be lower bounded by — 
the number of sector fetches under demand fetch, LRU replacement in a 
memory size as described above. However, Part B of Theorem 7 states 


that this conjecture is not true. 


Proof of Part B. 


We have to show that there exists a set of parameters such that 


FFp(jMp' | = up(t,T),N, Ma,StTa,Wp(t,1)) < FFs(|Ms] = kxT,ST = Sta, Fd, Rigy )- 
k 


Let: 
Program = ta,b,c,d,e,f,g,h}, a set 7 
‘8 relocatable sectors of size N/2. 
k = 2 
N = twice the sector size. 
T= 3. 
ST = (acd bef bgh acd aef b) be the sector trace. 
|ST] = 16. 
la = {{a,b}, {c,d}, fe, f},-{g,h}}, where page 
A = {a,b}, page B = {c,d)},etc. 
P = (A BB ACC ADD ABB ACC A) be the resulting page 


trace. 
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Wp(0,1) = m= 8. 
jMse| = ket = 6. 


Simulation of paging behavior to get FFp gives: 


P = ABB ACC ADD ABB ACC A 
Fu = ABO BCS 808 889 BCA 8 
Wip(+,T) = ABB ACC ADD ae ACC A 
AA BAA CAA DAA BAA C 
B c oO 8B 

lcapigets of Mp(t,T) immediately before 6th 


reference. 
Thus, FFp = 21°, 44! | = S page fetches. 


Simulation of sector behavior gives; 
ST = acd bef tgh acd aef b 
F = acd bef Ogh acd Sef b 
MN. «= acd bef bgh acd aef b 
ac dbe fbg hac dae f 
a cdb efb gha cda e 
acd def bgh hed a 
ac cde fig ghc d 


a acd efb bgh c 
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Results: 
FFs = £'8 (¢)] = 14 sector fetches. 
FFp = 6 < FFs/k = 14/2 = 7, QED. . F | 
Housvor: if we change the LRU replacement algorithm of Part B to the 
| optimum rep!tacement isonet: then the value of FFp under page uorking 
set management can be lower bounded. This lower bound is given by Part 


C of Theorem 7. 


Proof of Part C. 

Note that |Mp'| = up(t,T) < walt, T)max < T. 
a. 
FFp((M,| = up(t,1),N,fla,ST,,Wp(t, 1) 

> FFp’ (|Mp}] = u, (tT) maxeN, Ma, STa,Fd, Riau ), 
since Mp' = Wp(t,T) < Mp", by definition of Wp(t,T) and the 
definition of Mp" under demand fetch, LRU replacement; that is, 
Mp' always contains the set consisting of the iMp’ | = us(t, T) max 
most recently referenced pages, while. Mp! contains the set consisting 
of the up(t,T) most recently referenced pages. 


b. 
FFp’ ({Mp"] = te (t, Timex oN, Ma, ST, Fy Repu ) 


> FFst{M, | = kas (t, Tmax 9ST = STp oFy Ry} 
k 


by Theorem 1, and this proves part C of Theorem 7 


Corollary to Theorem 7, Part C. 


FF, (1M, | =u, (t,T),N, Ma,ST, ,W, (t,T)) 


> FF, (IM, | = f; (ug (ts Tmax »NeSS),ST = STi .Fy Ry) - A, 
Sone rg AON SE) po 
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where A and f, are defined as in Theorem Ss. 
Proof. 


We know from the proof of Part C that © 
FF, ({Mp' | = 4, (t,7),N, Ma,ST, apt, 1) 
> FF, ([Mp | = tg &t, Tie oN, Ha, ST, .Fed, Riau ), 


and applying Theorem 5 to FFp’ proves the corollary immediately. 


3.6.2 Upper Bounds for Working Set Managenent 


An upper bound on the number of page fetches for virtual memory 


systems using the pages working set strategy is given in Theorem 8. 


Theorem 8 
Bives any tuo-tevel virtual memory system V, with page size N, 

primary memory size [Mp | _ wp(t, 7), using page working set memory 
management Wp(t,T)}, and any sector trace STa, then for any partition, 

Ila, of the relocatable sectors into togical pages, where each page 
' contains k or fewer sectors, the maximus number of page fetches given by 
the page fetch function, FFp, is upper bounded by 

FFp({Mp' | = u, (t,T),N, Ma,STa,Wplt,T)) < FFs({Ms* | = u, (t,T),ST, Walt, T)), 
where the value of the sector fetch function FFs is the number of sector | 
-fetches which occur in a two-level virtual memory system V’, with 

primary memory size jMst | = usit,T), the same sector trace ST = STa, 
using sector working set management Ws(t,T). 

Proof: 


Let: 
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Q = {S, ,So,...,Sm} = {set of relocatable sectors 
of the program}. 
a= { M1, , Mp ,.-., Int be any partition of Q 


such that [Ij] < k, 


ST = x! x? ,...,x' be any sector trace, where 
x! ¢ Q, le ts«<l. 

P = A es be the page trace, where 
p'=j if xte Mj. 

Mp! = Wp(t,T) be the set of pages in memory 
of FFp at time t. 

Ie! = Ws(t,T) be the set of sectors in memory 
of FFs at time t. 


Fp 


thors omens = demand fetch policy of FFp. 

Rp = Pigts someyte = working set replacement 
policy of FFp. 

Fs = £1 #2 ,...,¢4 = demand fetch policy of FFs. 


Rs = ee eee at = working set replacement policy of 


FFs. 


Suppose at time t, in the FFp node!, that p' = j. the page j 
containing the set of [Ij sectors, is referenced. Then at time t, in 
the FFs model, ate a is the sector referenced, where a ¢« lj. We need 
to shou that Zh, [fh t < Shy dA. 

Case 1. Suppose p' ¢ Mp’! = Wplt-1,T); then fh = ¢. 


a. If x'e Ms‘! = Ws(t-1,T), then fh = 8 and [fh] = [fb]. 
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b. If xt ¢ Met! = Welt-1,1), then fl = fal © We(t-1,T) and 

Ly < yehy. | 

Case 2. Suppose p'« Mp’! = Wp(t-1,T); then fl =fj). 

a. If xte Met! = We(t-1,T), then # = tat # Weft-1,T) and 

beh t= (fg. 

b. If xte Met! = We(t-1,T), then fl = 6 and 

ffi} > [fh]. This condition itlustrates the only way that page 
fetches can exceed sector fetches. However, if we show that 

ple Wp(t-1,T) = > «le Ws(t-1,T), then case 2b can never occur. 

Let p'< Up(t-1,T), and senuwe: x! « Hett-1,T). Since x'e Wa(t-1,T), 
there exists a time t’ in the interval (t-1-T, t-1) such that 

x'= x". Let p" = k be the page referenced at time t’ in the 

page trace P. We know that x'e Mk, since sectors are not allowed to 
cross page boundaries. We also know that pe Wptt-1,T) because the 
window wize ts T for eat the page ree eee Up and the sector working 
set Hs. But this contradicts the assumption; therefore 

x! ¢ Ws(t-1,T). . 


Hence, bie jel < Ye pet | and the theorem is proved. 
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CHAPTER 4 
INTERSECTOR REFERENCE MODELS 


4.1 Introduction 


In the previous chapter, we presented upper and lower bounds on the 
wunber: GF page fetches which could occur ina virtual memory system, for 
a given program reference behavior, over any restructuring of the’ 
relocatable sectors into logical pages of the program. The next phase is 
to develop and present practical techniques for Kestcucturing a program 
to achieve good locality of reference for the program in virtual memory 
systems. The task of program reorganization for virtual memory systems 
will be separated into two logical parts. The first part is to develop 
automatic techniques for identifying the dynamic intersector reference 
behavior of programs executing in virtual memory systems. The second 
part is to provide clustering procedures which utilize the intersector 
reference behavior to rearrange the relocatable sectors of a program into 
its logical pages such that good focality of reference exists in the page 
trace of the restructured program. The basic idea of the second part is 


to assign the most strongly related sectors to cammon pages. 


In this chapter, we address the problem.of Intersector reference 
models. In the next chapter, automatic clustering procedures are 


presented, and finally, in Chapter 6, the results of applying these 
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methods to real programs are investigated and compared with the 


theoretical bounds. 


4.2 Intersector Reference Models 


It is known that a program's page reference patterns have a strong 
effect on paging per formance in virtual werory systems. It is afso known 
(H1} that the sector reference behavior of ‘any common programs, such as 
compilers, assembiers, editors, etc., proves to be remarkably insensitive 
to the input data in rather targe Scmesia: ‘For example, the studies of 
Hatfield and Geraid {Hil revealed diet Ninagr eubie ist eedhors which were 
used frequently together in the assembly of one program turned out to be 
essentially the same as the groups of sectors which were. used frequently 
together in the assembly of another program... The basic difference 
between assemblies was that the groups of sectors which were ieee 
caqethar for short input programs were simply used together more often 
for long pr ee Supported’ by these empirical observations of 
Hatfield and Gerald, we decided to characterize the reference behavior of 
a program by its sector trace and to base our practical restructuring 
methods on this reference behavior. We will elaborate on the soundness 
of this decision in Chapter 6 when we compare the paging per formance of 
real programs over program structures derived from different sector. 


traces. 
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Another important reason for basing restructuring methods on a 
sector trace is that the results of the last chapter may be used to 
compare the paging behavior of a restructured program with the 


theoretical best and worst paging behavior for that sector trace. 


Given a sector trace, our objective is to specify the strength of 
the intersector references such that a clustering procedure that groups 
the strongly connected sectors together into logical pages produces a 
program structure that tends to minimize the number of page fetches. We 
begin by presenting Hatfield and Gerald’s [HG] intersector reference 


model for defining the strength of connection between sectors. 
4.2.1 The HG Intersector Reference Model 

The HG intersector reference mode! consists of a symmetric matrix, 
H, showing the strength of connection between the sectors of the program 


to be reorganized. Let: 


Q = {S, ,S2,-..,Sm} be the program of m relocatable sectors; 


ST = s' ,s?,...,38! be a sector trace of the program. 


Then 


H = (Hij] for i,j = 1,2,...,m, where Hij = Zb,kCi,j,t), 
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where k(i,j,t) = 1 if S'=i ands!» j, or S' <j ands"! =i; 
and k(i,j,t) = 6 otherwise. 

Thus, the vatue of Hij is simply the number of times that sector i 
‘referenced sector j plus the number of times that sector j referenced 


sector i in the sector trace. 


Using this intersector reference model, Hatfield and Gerald were 
able to find improvements tn the number of page fetches on the order of 
tuo-to-one to ten-to-one by clustering sectors with large Hij values into 
the same eee. This is the same as clustering sectors Into pages such 
that the vatue of Hij is small for i and j in ditferent pages. 

Even though these results are quite impressive, the values of Hij in 
the HG intersector reference model do not centain any information about 

- the length of the time interval betueen auccessive references of sector i 
to sector j- Hence, the strength of connection, Hij, between sector | and 
j is the same for large time intervals and short time intervals. 

Houever, paging may depend quite heavily on the length of these time 
intervals. For exampte, assume that sector i references sector j 108 
times (Hij = 168) in a sector trace of 268,888 references. Now let’s 
consider tuo different plausible examples of how these references could — 
occur. First, these references could occur with short time intervals 
between them such that ail 188 references occur within 598 successive 
references of the sector trace. Second, these references could occur 
with some long time intervals bets#een them such that 18 of these- 


references could be found in each 20,888 successive references of the 
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sector trace. Even though the strength of connection is the same for 
these tuo examples, the tendency for a reference from sector i to sector 
j to cause a page fetch when they are not in the same page can be 


considerably larger in the second example. 


Furthermore, the tendency of a reference from sector i to sector j 
to cause a page fetch is related to such loca! information as the time 
elapsed since the last reference to sector j and the number of distinct 
sectors pafacenced since the last reference to sector j in the sector 
trace. If the time is short since sector j was last referenced, and 
little virtual memory space was used during that time, it is probable 
that sector j is still in primary memory and a new reference will not 
cause a page fetch. If the time and space traversed between references 
to j is large, it is likely that a page fetch will occur unless j is 
grouped into the same page as the referencing sector or some recently 
referenced sector. We will now present tuo intersector reference models 
which have potential for identifying and incorporating local sector 


reference behavior into the strength of connection between sectors. 
4.2.2 Working Set Intersector Reference Models 
The sector working set, Ws(t,T), will be used to define the strength 


of connection between sectors for a given sector trace. 


Let: 
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Q = {S,, So,...Sm} be a program of w-relocatable sectors. 
ST «5! 82 ye. ‘be a-sector trace of the program 

where S'e . 
P = P! ,p2,...P' be the resulting page deuce bi the 


program where P' is the page referenced at time t. 


If S' = Sj is the sector referenced at time t, then we define 
P'. Psj to denote the page referenced at tine t. Psj is to be 
interpreted as the page containing sector j. We have adopted this 


notation to make the folfoving discussion easter to under stand. 


“Recall that the sector working set, Wett,T), is defined to be the 
set of distinct sectors referenced in the time interval t-T to t of the 
sector trace. Simitarty, the page working set, Mp{t,T), ts the set of 
distinct pages referenced in the time interval t-T to t of the page 


trace. 


FACT 1. 
Let S'= Sj « and let Sj p Nslt-1,T). Then P'= Psj « Wp(t-1,T) 


iff Sj « Psi for some Si ¢« Ws(T-1,T). 


The proof of Fact 1 follows immediately from the definition of 
Wip(t-1,T), which is the set of distinct pages in the sequence 
Pst!" pgtl pst!) and the definition of 


Ws({t-1,T), which is the set of distinct sectors in the sequence 
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gi-!-T gi-T pees, 5h! . 


Fact 1 states that, when sector j is referenced at time t and sector 
j is not in the sector working set, then the page referenced at time t 
will be in the page working set if sector j is grouped into a page with 
any one of the sectors in the sector working set. Furthermore, it states 
that the page referenced at time t will not be in the page working set if 
sector j is not grouped into a page with one of the sectors in the sector 


working set. 


FACT 2. 
Let S'= Sj and let Sj ¢ Ws(t-1,T).. Then P'= Psj « Wp(t-1,T).- 
Fact 2 also follows immediately from the definition of Ws(t,T) and 


Wp(t,T). 


Fact 2 states that, when sector j is referenced at time t and sector 
j ts in the sector working set, then the page referenced at time t will 


be in the page working set. 


FACT 3. 
We want the entry Wij + Wji in the intersector reference model to be 
the number of page fetches which will go away if sector i and sector j 


are grouped into the same page. 
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Using the above three facts as a basis, we present the procedure 
for constructing the intersector reference model, W= (Wij], for i,j = 


1,2,...,m. At each instant of time, t, for 1 < t < L, do the following. 


Step 1. If S'= Sj and Sj e Ws(t-1,T), then increment Wij by 1 for all 


Si e« Ws(t-1,T). 
Step 2. If S'= Sj and Sj « Ws(t-1,T}, then increment Wjj by 1. 
‘Step 3. If Sos Sj and Sj « Ws(t-1,T), then no increment is required. 


Simply stated, the above procedure works as follows. If sector j is 
not in the sector working set when it is ketccenced: then increment its 
connectivity strength with all the sectors in the sector working set. 
Moreover, if sector j is in the sector working set when it is referenced, 
then do not change the. strength of connection between sector j and the 


other sectors. 


We observe that the value of the intersector strength becomes 
Wig = chk gt), 
where k(i,j,t) = 1 if S'= Sj « Us(t-1,T) and Si « Ws(t-1,T), 
1 if St= Sj e Ws(t-1,1) and i = j, 
8 otherwise. 
Note that Wij + Wji is the number of page fetches which will go away 
if sectors i and j are grouped. together in the same page. The sum of the 


diagonal elements of the intersector reference model, re Wjj, is 


138 


the number of sector fetches which occurred for the sector working set. 
This will also be the number of page fetches for the page working set If 
no sectors are combined together in pages. The number of page fetches 


after combining only sectors i and j will be 2%, Wjj - Wij -Wji. 


FACT 4. 
If exactly two sectors are grouped into each of the n logical pages, 
then the number of times a page is referenced and not found in the page 


working set is given by 


BRWiji- & Wij +Wji for l ck cn. 
i, jePk 
ixj 
Fact 4 follows directly from the construction of Wij, since Wij + 
Wji is the number of page fetches which are eliminated by grouping i and 
j together in the same page, and since grouping i and j together does not 


affect the value of Wy, + Wy, for grouping any other two sectors 


k and | together in a different page. 


Unfortunately, we cannot extend Fact 4 to handle the case when more 
than two sectors are allowed to be grouped into a page. This occurs 
because the matrix, W, does not contain enough information to determine 
the number of page fetches which will be eliminated by grouping three or 
more sectors into a page. For example, Wjj is the number of fetches of 
sector j. Wij and Wkj are the number of times that sector i and sector 


k,respectively, were in the working set when a fetch of j was made. The 
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problem is that sectors i and k both may have been in the sector working 
set at the time thakea reference to j Caused a fateh: Let the number of 
sector fetches of sector j, which will be resolved by grouping pectore 1, 
k, and j together into a page, be denoted by Rikj. | 

Then, 

MAX(Wij, WkKj) < Rikj < Wij + Wkj. 

We should point out at this time that the above relations can be 
utilized in a clustering procedure. Suppose sectors i, j, and k are 
grouped together into a page. Then the unresolved sector fetches of i, 
j» and k, denoted by U’ijk, is the number of page fetches of this page 
which will occur if no other sector is grouped with i, j, and k. 

But . . 
Wijk < Wii + Wjj + Wek - MINIRikj) - MIN [Rijk] - MINIRjkiD. 
Note, also, from Fact 4, that 


U’ij = Wii + Wjj - Wij - Uji, for the case of two sectors in a page. 


Therefore, a clustering procedure could dynamically determine a lower 
bound on the number. of page fetches which could be resolved by adding 


another sector to a page. 


Since the value of Wij depends on the window size T of the sector 
working set Ws(t,T), we need to elaborate on how one selects a "good 


value" for T. 
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For real programs, we aeadured the improvement in paging per formance 
for restructured programs as a function of T. That is, we computed the 
‘intersector reference mode! W for various values of T, and for each W we 
restructured the program and computed its paging performance. The 
detailed results of these experiments are presented in Chapter 6. 
However, the significant characteristics of these results are as follows. 
For a given program, the best improvements in paging performance, as a 
function of T, occur for a rather large bandwidth of T values. For 
example, values of 1888 < T < 5888 produced essentially the same and the 
best improvement in paging performance of certain programs. For all 
programs tested, the bandwidth of T values that resulted in the best 
improvement in paging performance was several thousand instructions; 
however, the location of this bandwidth of T values in the set of all T 
values varied from program to program. A serendipitous observation of 
the correlation between the bandwidth of good T values and the “knee” of 
the parachor curve of the sector fetch function, FFs(|Ms|,ST1T,Fd,Ro), 


produced an interesting empirical result. 


The parachor curve is a graph of FFs(|Ms|,ST,Fd,Ro) versus the 
amount of primary memory |Ms| available for execution. <A typical 
parachor curve for FFs is shown in Figure S. The value of FFs is a 
monotonically decreasing function of |Ms|. For most observed programs, 
there is a threshold region at which, 

a) if the amount of primary memory is decreased further, the number of 


sector fetches increases very rapidly, and, 
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b) if the amount of primary memory is increased further, the number of 


sector fetches decreases very slowly. 


This threshold. region is Sapieeen in Figure S'and is called the knee 
of the parachor curve. The values of {fs| in the knee of the parachor | 
indicate how many sectors are required to be in the primary memory to 
maintain a “reasonable” level of performance. ‘ 

Let the average sector working set. size be denoted by u, (T) and be 
defined as, 
uy (T)=(1/L)- 2b, walt, T) 

Now we present a method which identifies values of the window size T 


for use in the construction of the intersector reference model W. 


Experimental Result: 

For all the programs we tested, the bandwidth of T values which 
resulted in the best tmprovement in paging per formance barceapands to 
those values of T for which the average ‘sector working set size wu, (T) 
was equal to 
a) some vatue of {Ms]| in ‘the knee of the parachor curve of 
FFs(|Msj],ST,Fd,Ro), or to 
b) some value of {fMs| slightly smaller than those values of |Ms| found in 


the knee of the parachor curve. 


This experimental result was particularly handy in our research, 


since we had already computed the parachor curve of FFs({[Ms|,S1T,Fd,Ro) 
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FFs 


2 FFs (|{Ms|,ST,Fd,Ro) 


Values for W, (T) 


[Ms | 


FIGURE S. 


Parachor Curve of FFs {{Ms],ST,Fd,Ro) 
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for use in establishing the lower bounds. 


If the window size, T, is very small, for example T=1, then the 
value of Wij is much ftarger than the number of page fetches hucclved by 
grouping i and j together for most memory sizes. On the other hand, if 
the vatue of T is very large, for example 25,888, then the value of Wij 
is much smaller than the number of page fetches resolved by grouping i 
and j together for most sennrG sizes. However, if T is such that the 
average working set size is in the knee of the parachor curve, then the 
value of wij represents the idteraector activity when the program has 
just enough space to execute efficiently. This corresponds to the 
inter sector activity that we want to represent in the intersector 
- peference model, W. 

In addition to the above intersecter reference mode! based on the 
sector working set, we decided to investigate the potential of the 
following model. Let the intersector reference, W’, be am x m matrix 


defined as follows: 


Wij = i kCi,j,t) for i,j = 1,2,..-.m, 
where k(i,j,t) = 1 if S = Sj ¢ Walt-1,T) and Si ¢ Wslt-1,T); 


8 otherwise. 


The value of W’ij is the number of times that sector j was 
referenced when sector j and sector i uere both in the sector working 
set. Therefore, if the value of Wij is farge, then Si and Sj were in 


the sector working set together many times. Note that W’jj is the number 
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of references to sector j which will not cause a page fetch. In 
contrast, Wjj of the previous model is the number of references to sector 
j which will cause a page fetch unless Sj is grouped with some Si. 
However, W’ij does measure the tendency for sectors.i and j to be found 
in the sector working set together. Clustering procedures which group 
sectors into pages with large W’ij values will tend to reduce the size of 
the page working set and hence increase the locality of the restructured 


program. 


We conclude with a few comments about the intersector reference 
models based on the sector working set, Ws(t,T). The HG intersector 
reference model, H, is a special case of the intersector reference model, 
W. They are the same when W is computed from a sector working set with 
window size, T, equal to one. The notion of using sector working sets to 
define the strength of connection Getueen blocks has been jiveet gated: 
concurrently but independently of this work by Masuda [MG] and Ferrari 
(Fll. Masuda’s use of block working sets is quite different from this 


work, while Ferrari’s is similar in some aspects. 


4.2.3 LRU Stack Intersector Reference Model 


The “LRU sector stack” will be used to define the strength of 


connection between sectors for a given sector trace. 
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Gans ider demand fetch, LRU reptacewent en a sector trace, 
st = 5',s?,...,S',...,5', over a set of mretecatable sectors. 
From Chapter 2, we know eat LAU satisfies the inclusion property, i.e., 
tts! (1) ¢ Ms! (2) ¢ 22. ¢ Me! tat) = Me! te’ at) = Mat te! 42)... 
where Ma' {j) is the contents of the sector mesory Ms at time t when the 
size of Ms is j sector frames fi.e., jis! | = j}, and m' is the number 


of distinct sectors referenced in the sequence §! £S* 244245! 


Because of the inclusion property, the primary memory contents Mst 
at any time t and for alt capacities can be represented in the fol lowing 
terse and useful way. We order the distinct set of sectors in the 
sequence S| ,S?,...,S' into a list called the LRU sector stack which 
is defined as SS'= SS! (1),SS! (2),...,SS! te!) here 
ss! (i) = Ma! (i)-Me! €i-1). Note that 


Me' (i) = iss ¢1),Ss' (2),...5S' Ci for i <n; 
iss' (1),SS' (2),...SS' Gat} for b> at. 


The LRU sector stack has no entries at time t = 8. The top of the 
stack is defined as SS' (1), while the bottom of the stack is defined as 


ss! (m'). 


The LRU sector stack, just after sector reference St at time t, is 
simply the list of the set of m' sectors of the program ordered 
“according to recency of usage; i.e., SS’ fk) ts the kth most recently 


used sector retative to S'. 
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The position of sector j in the stack just before sector reference 
S', at time t, is defined as the sector stack distance and is denoted 
by at j. Fur thermore, at j =o if Sj has not been referenced. Thus, 
a’ j “ if SS' (kK) = Sj. Lek cat 

eo otherwise 

From the definition of stack distances, we observe that S' = Sj 
will cause a sector: fetch under demand fetch, LRU replacement unless 
a' j < [Ms] where |Ms| is the number of sector frames in the sectored 


primary memory. 


Now, two facts are presented which relate the sector stack distances 
at time t with the parameters of a paged virtual memory system using 
demand fetch and LRU replacement on the page trace 
P =p! ,p?,...,p',...,p' in a primary memory of [Mp] page frames. 

The page, p', referenced at time t must contain the sector s', 


referenced at time t. 


FACT 1. 
Let S'= Sj, and let a'j > IMp|. Then p'« Mp if Sj is 


grouped into the same page with some Si where abi < |Mp]. 


Proof. 
Note that a'j > [Np] states that the sector stack distance at time 
t to sector j is greater than the number of page frames in Mp. 


Suppose Sj is grouped with some Si, where abi< jMpj.. Then the sector, 
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Si, is among the. [ftp] most recently referenced sectors. Therefore, the 
page containing Si must be azong the fip{ wost recently referenced pages, 


since Ne are assuming that the secters are saafler than pages. 


FACT 2. 

Let S'= Sj, and let al j < [Mp]. Then pie Mp! . 
Fact 2 foltous. from the ioument applied to Si in Fact 1. We can use 
Facts 1 and 2 as a basis for defining the strength of connection between 
sectors. Fact 2 states that, if S'= Sj and a'j < [Mp], then Sj will 
not cause a page fetch; hence, for such references, the strength of 
connection between Sj} and the other sectors need not be incremented. 
Houever, if 4'j > [ttpl, then Sj will not cause a page fetch when it is 
grouped with any sector Si with ati < [tp]. For the fatter case, the 
strength of connection tetueen Sj and att Si with abi < [Mpt will be 


incremented by 1. 


Nou, we define the intersector reference model based on the LRU 


sector stack distance as awx m matrix, U, where 
Vij = Dh Vvei, jt) and 


1 if S'= Sj and a'j > D and ati < D; 
VCi,j,t) = 1 if S'= Sj and atj > D and i = j; 
8 otherwise. ; 
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If the value of D is one, then the intersector reference model, U, 
-is the same as the intersector reference mode! of Hatfield and Gerald. 
Houever, we got the best results (fewest page fetches after 
restructuring) with vatues of 0 equal to the number of sectors, |Ms|, 
corresponding to the high side of the knee of the parachor curve 
FFs(|Ms|,ST,Fd,Ro). Figure 6 shows the typical shape of FFs as a 
function of |[Ms| and the range of the values of D which gave excellent 


results for all real programs we investigated. 


One explanation which provides some insight into why the values of D 
corresponding to the knee region of FFs produce reasonable values for the 


strengths of connection between sectors is as follows. 


If D ts very small, say 1, then the strength of connection betueen 
tuo sectors, Uij. is proportional to the number of page fetches only when 
the paged primary memory has one page frame. However, most large 
programs will not execute efficiently when allocated one page frame. If 
the value of |Mp| for efficient execution is much larger than D=1, then 
the strength of connection Uij for some i and j may not even be foosely 
proportional to the number of page fetches resolved when they are grouped 
together. For very small values of D, Uij may be excessively larger than 
the number of page fetches which are resolved by grouping | and j 
together; for very large values of 0, Uij may be excessively smaller 
than the number of page fetches resolved when i and j are placed 


together. Values of D in the region of the knee of the curve represent 
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the intersector activity when the program has just enough space to 
execute efficiently. This is the intersector activity that we want the 


intersector reference model to measure. 
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CHAPTER 5 


CLUSTERING PROCEDURES 


S.1 Introduction 


The purpose of this chapter is to present the automatic clustering 
methods which were used in conjunction with the intersector reference 
models to restructure programs. The Supevineneae pegul €s which show the 
aetcet of these clustering techniques on the paging performance of 


restructured programs. are presented in Chapter 6. 


5.2 Clustering Procedures 


The clustering methods presented in this chapter may be. applied to 
any of the intersector reference matrix models of Chapter 4. Hence, we 
will denote any of these intersector reference models with the generic 
C = (Cij]. In those cases where a particular intersector reference 


model is needed, the notation of Chapter 4 will be used. 


We know of no efficient. procedure to produce and prove the optimal 


partition of sectors into pages to maximize the sum of. the intersector 
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connections Cij within all pages. Several clustering pee etnaa based 
on heuristic approaches are presented in this chapter which have the 
following significant proper ties. ‘Firet, they are completely automatics 
that is, these procedures are not ‘based on manual or "eyebal 1" 

reorder ings. Second, all these procedures produced restructured 
programs which showed substantial improvements in their paging: 


performance. Third, these clustering procedures are quite fast. . 


The technique of the follouing clustering procedures is to take an 
intersector reference model of intersector bond strengths and cluster 
relocatable sectors into pages such that the sum of the sector bonds 


within pages tends ‘to be maximized. 


5.3 Nearest Neighbor Methods 


In this section, we present several hierarchical methods uhich 
cluster the nearest two clusters under a specified bond strength 


definition one after another. 


Given any two clusters of relocatable sectors, Gx and Gy, the 
intercluster bond is denoted by B{x,y). Several intercluster bond 
definitions are given below; then a clustering procedure is defined 


over the intercluster bonds. 
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In the following definitions, the intersector reference matrix, 
C = (Cijl], is assumed to be symmetric. ‘If the intersector reference 
matrix is not symmetric, then each occurrence of Cij should be replaced 
with (Cij + Cji)/2. The notation |Gx| denotes the size of cluster Gx ‘In 


bytes, and N denotes the page size in bytes. 


A. Constrained Nearest Neighbor Bond 


The Constrained Nearest Neighbor bond, CNN, between any tuo 


clusters Gx and Gy is defined as 


Bix,y) = Max {Cij :  ieGx, jeGy} when [Gx] + [Gy] < N. 


undefined when |Gx| + |Gy| > N.- 


B. Constrained Farthest Neighbor bond 
The Constrained Farthest Neighbor Bond, CFN, between any tuo 


clusters, Gx and Gy, is defined as 


Bix,y) = min {(Cijs ieGx, jeGy} when [Gx] + [Gy] < N; 


undefined when |Gx| + [Gy|>N. 


C. Constrained Average Neighbor Bond 
- The Constrained Average Neighbor bond, CAN, between any two 


clusters, Gx and Gy, is defined as 
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Bix,y) = (i/n,y) Zegx Zegy Cij when [Ge] + [Gy] < N; 


undefined when [Gx] + |Gyj > N. 


Here n,, is the number of Cij > 8 with i « Gx, j € Gy. Note that ny is 
the number of arcs between Gx and Gy, and it is not the sum of the. 


values on these arcs. 


0. Constrained Average Neighbor Weighted Bend 
The Constrained Average Neighbor Weighted bond, CANW, between any 


tuo clusters, Gx and Gy, is defined as 


Bix,y) = ny® (l/r) Zece Zecy Cij when |Gx} + IGyl < N; 


undefined when |[Gx{+/Gy] > N. 


Hence, 


Bix,y) = Leg Ziegy Cij when |Gx| + [Gy] < N. 


A clustering procedure is now defined for use with any one of the . 


above definitions of B{x,y). 


Firgt, choose any one of the above definitions of B(x,y). Second, 
partition the m relocatable sectors of a program into exactly m 
clusters, where each cluster contains one sector. Then, at each step. in 
the clustering process, the nearest tuo clusters are combined to form a 


new cluster. The nearest two clusters are defined to be the two 
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clusters Gx and Gy which have the jargest value of Bix,y). When the sum 
of the size of the tuo clusters becomes larger than the page size in the 
clustering process, these two clusters are not considered to be 
connected; that is, their bond strength is undefined. The process 


comes to an end uhen new clusters cease to appear. 


When the above clustering procedure is applied to the Constrained 
Nearest Neighbor bond definition of B(x,y), it will be referred to as 
the CNN procedure; when applied to the CAN definition of Blx,y), it 


will be referred to as the CAN procedure, etc. 


All of these clustering methods are computationally fast, easy to 
implement, and they tend to group the sectors with the strongest 
intersector strengths, Cij, into the same page. Hence, they tend to 


minimize the interaction of sectors clustered into different pages. 


The CNN, CFN, and CAN procedures are variations of clustering 
procedures which are widely baed in the field of multivariate analysis. 
The Ganstcstaed Average Neighbor Weighted bond, CANW, procedure was 
developed in this research. In fact, we experimented with several 
weighted versions of the CNN, CFN and CAN procedures. However, the CANW 
procedure consistently produced program structures which required fewer 
page fetches than the program structures produced by the CNN, CFN, and 
CAN procedures or by any of the other weighted versions we examined. 


One explanation for the success of the CANW procedure is that at each 


oye 
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step it combines the two clusters which have the most total intersector 


connections between then. 


In the above Constrained Neighbor bond definitions, CNN, CFN, CAN, 
and CANW, the constraint {Gx{.+ [Gy] <'N insures that the size of a 
cluster never exceeds the page size. However, natural clusters of 
sectors may in reality be larger or smatier than a page size. It is of 
course conceivable to make clusters covering several pages without any 
consideration of page sizes and to assign each of them to several 
contiguous pages. In order to evaluate the merits of allowing clusters 
to become any natural size, we experimented with 
a) the Unconstrained Nearest Neighbor bond, UNN, 
b) the Unconstrained Farthest Neighbor ‘bond, UFN, 
c) the Unconstrained Average ‘Neighber bond, UAN, and 
d) the Unconstrained Average Neighbor Weighted bond, UANH, 
where UNN, UFN, UAN, and UANN are defined to be exactly the same as CNN, 
CFN, CAN, and CANH, respectively, with the exception that the constraint 
[Gx] + {Gy] < N is not present in the unconstrained cases. That is, in 
the unconstrained cases, clusters may be combined independently of their 


sizes. 


The clustering procedure for the constrained clusters had to be 
modified slightly in order to be applicable for the unconstrained 
clusters. The clustering procedure for the unconstrained clusters is as 


‘follous. 
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Choose any one of the unconstrained definitions of B(x,y). 
Partition the m relocatable sectors of a ancaeiaie into exactly m 
clusters, where each cluster contains one sector. Then, at each step in 
the clustering process, the nearest two clusters (i.e., the two with the 


largest value of B(x,y)) are combined. Now ne will define what we mean 


by combine. 


Let the two clusters which are to be combined at any step of the 
clustering process be denoted by i 

Gx = Sx,,5x2,-..,5%; and 

Gy = Sy;,Su2,---,Suj, 
where the cluster Gx is defined to be the ordered list of i sectors, and 
the cluster Gy is defined to be the ordered list of j sectors, The 
combination of the misters Gx + Gy is defined to be the ordered list of 
i + j sectors 


Gx + Gy = Sx,,Sx2,.+-,S%j,5yj,SUz. +++» SY;- 


Since each cluster starts out with one sector, the above definition 
of combining two clusters insures that the relative order in which 
sectors are clustered is preserved. This is important in the 
unconstrained case, because the clustering procedure ends when all the 
clusters which are connected are grouped into one giant cluster, which 


could be the whole program. 
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Note that the order of the sectors in the constrained clusters is. 


not important, because a constrained cluster will always fit into a 


page. 


5.4 Hatfield and Gerald Method 


The Hatfield and Gerald clustering procedure can be applied to any 
intersector reference matrix model, C = [Cij}. The HG clustering 
procedure is defined in detai! in [Hl] and is briefly summarized below. 
Let 

E = [Eijl, i,j = 1,2,...,m (mis the number of sectors), 

where 

Eij = -Cij when inj 

Pa Cij + 2m when i = j. 
The javecwe mares: of E is calculated, then a row in the inverse is 


chosen, and a set of sectors in that row are clustered into a page, and 


the process is iterated until! all sectors are assigned. 


We thank Don Hatfield for providing a copy of his restructuring 


program for use in our restructuring experiments. 
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5.5 Sector Interchange Procedure 


The sector interchange procedure, SIP, is developed in this 
section. The SIP begins with the set of m relocatable decor’ of a 
program partitioned into n blocks. That is, assume that a partition, I, 
of the set of sectors, {S,;,S2,...,Sm}, making up a program is given. 
Let II be denoted by 
Tl = {H, ,lM2,...,Int where |Ij| is the number of sectors in the j-th 


block of II. 


The blocks, IIx, of Il may represent the logical pages of a program, 
where the sum of the sizes of the sectors shinee a block of Il is less 
than the page size, or the blocks of Il may represent natural clusters of 
sectors, where the sum of the sizes of the sectors making up a block may 


be greater than a page size. 


The basic strategy of the sector sisveccnedee Gaccodare: SIP, is to 
reassign sectors to blocks of Il by exchanging two sectors of different 
blocks when the exchange provides a positive contribution to the sum of 
the sector connections within blocks. In order 6 be more precise, we 
need to define a few terms. Let 

C = (Cij] be a aguinate te intersector reference 

matrix for i,j < m, and 


P = (S,;,S2,-..,5m} denote the set of sectors 


making up a program. 
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Definitions: 

The complement of Tx is denoted —Ilx and 
“x = {1j «€ 1: Mj « Hx} 

Let Si « Ex; then the intrablock 
bond of sector i, Si, wlth black fix ts 
defined as | 
Bti, Mx) = 24,, Cij 

Let Si « [x and Si ¢ Hy; then the interb lock 
bond fae bee i with block Hy is defined as 
Bi, My) = Ley Cij 

Let Si ¢ IIx; then the interblock bond pf sector 
i with all other blocks jis defined as 
Bli,~Mx) = Zien, Cij 

The quality of the bond for the ith sector is defined as 
g, (i)<BUi, Hx) - BU,-lx), where Si Tx. 

The quality of a sector partition I is | 
defined as 


Q, = Zep Gn fi) 


The goal of the sector interchange procedure, SIP, is to maximize 
the quality Q, by interchanging sectors. between blocks of the 
partition. We now present an efficient method to find an optimal 
assignment of sectors to blocks under the constraint that each 
‘interchange consists of exchanging a sector of one block with a sector 


of another block. 
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Lemma 6 
Let Si « IIx and Sj ¢ My. If Si and Sj are interchanged, the net 
gain in the quality Q,, denoted by 4Q, (i,j), is given by 


4], (i,j) = 4(B(j,Mx) - Blj,My) + Bli,fMy) - Bli,Mx) - 2Cij). 


Proof: 

Let Si ¢« Ix, Sj ¢ My and IIx, My ¢ Il. Now, interchange sectors Si 
and Sj which produces the new partition I’. 
A @, (i,j) = Q, - Of = Loep gy, {k) - Zqep a, (hk) = Zgeep a, (kK) - ay (hk). 
Let A qk) =q, (k) - qy (k). 


Now we consider 5 cases. 


Case 1. A qtk) 


2(Ckj - Cki) for all ke Ix, kei. 


Case 2. A qk) = 2(Cki - Ckj) for all ke My, kaj. 


Case 3. A qtk) @ for all ke ~(fly + IIx) 


Case 4. aA qli) = B(j,Mx) - Bj,My) - B(j,Mx + My) - 2Cij 


- Bi, Mx) + Bi, My) + Bi, Mx + My) 


Case 5. A qlj) = B(j,Mx) ~ B(j,My) + B(j, Mx + My) - 2Cij 


- Bi, Mx) + Bi, My) - Bli, Ix + My). 
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Nou, 
4Q, (i,j) = 2 q(k) + 2 A qlk) + Aqli) + A qlj) 
ke nx keny 
ki kz j 
= 2(B(j,Mx) - Bli, IIx) - Cijl 
+ 2{B(i,My) - Blj,My) - Cijl + A qli) + A qfj) 
4 Q, (i,j) = 4(BCj,Mx) - BCj,My) + Bli, My) - Bli, Mx) - 2Cij). 


QEO. 


Now we present a Lemma which permits us to quickly select the Sj and Si 


for exchange. 
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Lemma 7: 


If OQ, (i,j) is positive, then g, Cil+q, (j) is negative. 


Proof: 
q,{i} = BCi, Mx) - Bli, Ix) 
= Bi, Mx) - Bli, My) - Bli,-(iMx+Ily)) 
similarly, 


q, (j) = BUj,My) - Bj, Mx) - BCj,+UIxely)) 


From Lemma 6, 
4 Q, (i,j) = 4(B(j,Mx) - Blj,My) + Bli,My) - B(i, Mx) - 2Cij). Hence, 
A Q, (i,j) = -4{q, (i) + q, Gj) + BUi,-Ulx + My)) + BCj,7U1 x + My) + 2009). 
But B(i,-(Mx + My)) + B(j,-(Ix + My)) + 2Cij > 8, and 
4 Q, (i,j) > @ Thus q, (i) + q, (Cj) < B. 


geD. 


FACT l: 
The maximum value of AQ, (i,j) = -4(q, (i) + q, (j)). 


This fact follous directly from the proof of Lemma 7. 


FACT 2: 

If AQ, (i,j) > 8, then (i,j) must. be an element of the 
Interchange set, I, , where 
1,2 !€i,j) : q, Cideq, (j) < 8, i,je Ph. 


This fact follows immediately from Lemma 7. 
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Now we iteratively define the sector interchange procedure, SIP. 
_ We assume that an initial partition, n°, and an intersector reference 


matrix, C, are given. 


The operations performed in the kth pass are these: 
a. Compute the set T yk 
b. Select a pair (i,j) such that: 


A Oye (i,j) > AQ 4 luv) for 


n* 
all (u,v) € Ippk-i 

c. If A QK-1 (i,j) > @, then interchange sectors i and j 
of TI! to get mM, and go to the (k + 1)th pass. 


If 4 Opk1 (i,j) <8, then stop with a! 


The SIP has to terminate at some pass k, since Cij is finite. If it 
terminates on the kth step, then nm! is optimum in the sense that 

no pairuise interchange can increase the value of Qyk-1- This is 
obvious, since LyK-1 contains all the possibte candidates (i,j) that 
could possibly make A O yk-t positive, and since at termination 


A OQ pyk-1 (u,v) < 8 for all’ fu,vie I yk-1 . 


In each pass of the previous algorithm, by keeping the list of 
sectors in the set I yyk-t sorted and using Fact 1, the algorithm can be 


made much more efficient. 
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The sector interchange procedure, SIP, is particularly useful when 
one has a partition, II, where the blocks of Il represent natural clusters 
of sectors. Another application of SIP is in the evaluation of breaking 


up huge sectors. into smaller parts by reprogramming. 


An ongoing research project between the author and Don Hatfield of 
IBN is to evaluate. the potential benefit of reprogramning and then 
restructuring a very targe data base system. — The rationale for 
reprogramming is to divide the very large sectors (over 18 pages long) 
into relocatable subsectors and then restructure the new program. 
Theorem 1 can be used to predict the theoretical best paging per formance 
if the large data base program were broken up sntevensctly k sectors per 
page. Then, given an intersector reference matrix and a partition, I, 
of k sectors per block, the sector interchange procedure, SIP, can be 


used to restructure the program. 


5.6 Intercluster Bonding Method 


The purpose of the intercluster bonding method is to identify 
natural clusters of dense sector interactions. This task is 
accomplished by permuting the rows and columns of an intersector 
reference matrix model in such a way as to group the numerically larger 


matrix elements together. 
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The definition of the intercluster bond measure is given first, 
then we illustrate the capability of this measure to cluster the larger 
matrix elements together, and then we present a fast approximate method 
of permuting the rows and columns of a given matrix such that the 


intercluster bond measure tends to be maximized. 


Given a symmetric intersector reference matrix C = {(Cij] for 
i,j = 1,2,...,m which represents the intersector activity between the m 
relocatable sectors of a program, we define the intercluster bond 


measure, ICB, as 


ICB{C) = rr el Cij (C._,j + Ci + Ci +0; 5.) 
where Co; = Celi = Cio = Ci mst = 8 by definition and Cij > 8. 
We point out that the bond strength between two nearest-neighbor 


elements of C is their product. 


The intercluster bond measure, ICB, is defined so that a matrix C 
that has dense clusters of numerically large elements will have a large 
ICB when Acpeaeny with the same matrix whose carunis and rous are 
permuted such that numerically large elements are more uniformly 
distributed over the array cells. In order to illustrate the 
sensitivity of ICB(C) to the degree of clumpiness of the large values of 
Cij, we present the following two simple examples. Example 1 shows the 


same matrix with 5 different row and column permutations. Matrix Cs 
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which has the largest intercluster bond measure contains tuo 
noninteracting clusters. One cluster consists of the sectors a and c, 
while the “ther cluster consists of the sectors b and d. The fact that 
matrix C,; could be reordered to produce tuo noninteracting clusters is 
not readily apparent even for this simple example. Example 2 shows a 
slightly more complicated matrix. Matrix C,gof example 2 is | 
characterized by a block checkerboard form, where the blocks of sectors 
along the main diagonal represent the primary sector clusters and the 
off-diagonal blocks indicate the intercluster interactions. Matrix Cs 
which has the largest intersector bond measure of Example 2 has the same 
set of primary clusters as Matrix C, but it differs from C, in that 

the clusters which interact the most are ordered adjacent to each other. 
The intercluster Sanu weaguck: ICB, tends to be maximum when the most 
strongly intraconnected sectors are clustered together and the most 
strongly interconnected clusters are clustered together. We call ICB 
the intercluster bond measure because it tends to cluster the 


intercluster connections as well as cluster sectors. . 


In our experimental studies, sector orderings which produced the 
largest values for the intercluster bond measure provided as good as or 
better improvements in the paging performance than any other program 


restructuring method tested. 
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ICB(C,) = 256 


a b d c 

18 8 B 18 

18 8 B 18 
8 8 8 8 
8 8 8 B 
C, matrix 


ICB(C4) = 912 
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a 8 8 4 4 g 1 
b 8 i) 4 4 8 ] 
c 8 8 8 8 1 1 
d 8 8 8 8 1 1 
e 8 8 18 8 8 | 
f 6 $8 18 8 8 8 
g 1 1 8 8 7 7 
h 1 1 8 § 68 7 7 
Cy 
ICB(C,) = 2776 
a 4 4 8 8 8 1 
b 4 4 ] 8 8 8 
e 8 18 8 8 8 8 
f 68 18 8 8 rs] 8 
c 8 8 8 8 1 1 
d ) 8 8. 8 1 1 
g Q 8 1 1 7 7 
h 8 9 1 1 7 7 


Cs 


ICBIC, ) = 3536 


Note that the definition of ICB may be decomposed into the two 


parts as follows: 


ICB(C) = ICB(Cp )+ICB(Cc), where 

ICB (Cp ) = Pa rie Ci j (C14; + Ci j ) 

ICB(Cc) = £5.) 2", Cij(Cy., + Cy) 

The value of ICB(Cgp) is the sum of the row bonds and the value of 


ICB(Cc) is the sum of the column bonds. 
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Property 1: 
The values of the row bonds, re Cij(C.,, + Ci.) 


. are not affected by any permutation of the m columns of C. 


Proof: 
Let ={r (1), A (2),... A (m)} denote. any permutation 
of the m columns of C producing the new matrix 
D=(Di jJ=(C,.() 1. 
Then, for any 1 < i <n, 
Byer CHG + Corp d= Fh Cam Cram + Crag) 
This is clearly true, since i is fixed over the summation of all j. 
Thus, for every term in the summation on the left, 
Cijl(C_,; + C,,,), there must be a value k, 1 ck <m, 
such that 


Cijl.) 7 + Cai = Cin Crrad + Carrw)- 


Property 2: 
The values of the column bonds, 2", Cij(C,,, + C4) : 
are not affected by any permutation of the m rows of C. 


Proof is the same as that of property l. 
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Property 3: 


ICB(Cy) =1CB{Cc) for symmetric matrices C. 


Proof: 


ICBI(Ce,) ma zt, Ci jit, +6341, ) 


= Ih Thy Cpiey, 0 yie1 ) 


2h BL, Chip yy HC) 
ICBICc). 


Proper ty 4: 
The contribution to ICB{C) from any. row. is onty affected by the two 
adjacent rows. The contribution to ICHIE) from any column is only 


affected by the tuo adjacent columns. 


Property 4 is obvious, since the contribution to ICB(C) from any 
row i is re Ci j(C.,, +0145) and from any. 


columm j is 25, Cijl,, +), )- 


From properties 1 and ,2 the maximization of ICB(C) over allt column 
and row permutations reduces to tuo separate optimizations. One is for 


the rows, ICB(C,), and the other for the columns, ICB(Cc). 


From properties 1, 2, and 3, we know that the row permutation which 
maximizes ICB{Cp), is the same as the column permutation that 


maximizes ICB(Cc). Thus, at! we need to do is find a row permutation 
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that maximizes ICB(Cp), then reorder the rows and columns of C 


according to this permutation to maximize ICB(C). 


The problem can be stated formally as follows: 
Let A =LA (1), a {(2),..., A (m)) denote a permutation 
of m columns of C producing the new matrix 
O=(Dij) = (C,,@ ). 
Maximization of the summed column bonds ICB(Cc) is given by, 
Max over A of £4, 2%, Oij (0,,, + O:,,), 
where A enue over all m! possible permutations. 
This may be transformed into a quadratic assignment problem for which 
optimal and suboptimal algorithms have been published [G3]. These 
suboptimal algorithms were not used, since they are too time comsuming 
for large m, i.e., they require operations which rise with the fifth 


power of the matrix size. 


Now we define a suboptimal method which exploits the 
nearest-neighbor feature (MS) of property 4. This method is much faster 
than the optima! methods and is believed to produce near optimal 
orderings. The intercluster bond method is as follows: 

A. First compute and save the set of intercolumn bonds for all pairs 
(i,j) of columns, i.e., 
rey Cy * Cy for all l < i,j<em, i # j. 


B. Pick one of the columns arbitrarily, put it into a list, and set 
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k=1, 

C. For each of the remaining m-k columns, compute the contribution to 
the intercluster bond measure for each of the k+l possible positions to 
the left and to the right of each of the k columns already placed in the 
fist. Place thie column that gives the largest incremental contribution 
to the intercluster bond measure in its best location in the list. 


D. If k=m, stop; otherwise, increment k by 1 and repeat step C. 


When the above procedure terminates, simply order the rous and 


columns of C in accordance with the list of columns. 


Property S: 
The time for the execution of the clustering process in step C 
grows as m°. 


To see this, note that 


me kel) (mk) = m?/6 + m2/2 - (2m/3). 


The intercluster bond method will cluster the sectors into disjoint 


groups if this is possible. 
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CHAPTER 6 


EXPERIMENTAL RESULTS 


6.1 Introduction 


The purpose of this chapter is to report on an experimental study 
of the paging performance of programs. The objective of this study is 
to evaluate the practical restructuring methods developed in Chapters 4 
and 5S. The evaluation consists of two basic parts. First, the paging 
per formance produced by the different restructuring methods are related 
and contrasted with one another. Second, the improvements in paging 
per formance produced by the practical restructuring methods are compared 
with the theoretical best and worst improvements as given by the bounds 


in Chapter 3. 


We have performed experiments, using the IBM System/368 Mode! 67 at 
the Cambridge Scientific Center, on compilers, assemblers and a large 
data base program. The results of a specific example will be presented 
in detail. We have chosen as an example the restructuring of a highly 
modular compiler [A3]. This example is selected because we have 
experimental results for all of our restructuring methods applied to 
this compiler. The author and Don Hatfield of IBM plan to publish the 


' results of using some of these methods to restructure a “large data 
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base" system as soon as our results are completed. 


This compiler has 4 phases. Phase @ is a very small root phase 
which simply has Phase 1 read in, and, when Phase 1 is over, has Phase 2 
read in, and, when Phase 2 is over, has Phase 3 read in. Each of the 
phases is a separate overlay in the sense that they do not share any 
address space. Therefore, we may think of Phases 1, 2, and 3 as three 
separate programs. There are between 78 and 108 relocatable gactore per 
phase. For each compilation, we computed three distinct sector traces. 
One trace was for Phase 1, one for Phase 2, and one for Phase 3. In 
particular, from the time that a phase was loaded into the address space 
until its subsequent removal, a full instruction trace of all references 
to the relocatable modules of that phase was recorded. This instruction 
trace and the load address of all! the relocatable sectors (modules) are 


sufficient to compute the sector trace. 


In order to compare the sPreetivendes of the different arrangements 
of sectors into the virtual address space, LRU and OPT paging simulators 
were developed for a single user paging against himself. Input to the 
simulator was a sequence of page requests generated from the full 
instruction trace and a new ordering of sectors into the address space. 


A modified version of the one pass OPT algorithm by Palermo and Belady 


(B6] was used as the OPT paging simulator. 
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When sectors have been assigned to pages, one problem remains. 
What to do about page boundaries? Holes in pages can occur if sectors 
do not fit evenly into pages. For most real programs, we have two 
alternatives. First, we do not allow sectors to cross page boundaries, 
which may cause empty space within the pages. Second, we pack sectors 
one after another into the virtual address space, leaving no holes but 
allowing the sectors to cross page boundaries. Hatfield [Hl] has 


reported on the relative success of the latter approach. 


For our experiments, we packed sectors one after another into the 
virtual address space, leaving no holes between the sectors. That is, 
given a partition Il of the sectors in blocks, we placed the blocks of 
the partitions into the virtual address space one after another. The 
unconstrained average neighbor weighted bond, UANW, procedure was used 
to automatically order the clusters for insertion into the address 


space, unless the clustering procedure produced ordered clusters. 


The next fen sections report on the results of the restructuring 
experiments performed on the different phases of the compiler. The 


basic structure of these experiments on each phase is as follows. 


A. A full instruction trace is recorded and mapped into a sector 
trace. 
B. An intersector reference matrix model is constructed ‘from the 


sector trace. 7 
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C. A clustering procedure, based on a particular intersector 
reference matrix, is used to partition the relocatable sectors into 
blocks. 

D. The resulting ordered blocks of the partition are inserted into 
the address space one after another. 

E. The paging performance of the restructured program is simulated 
using LRU replacement (sometimes OPT replacement is used). We 
chose LRU replacement because so many contemporary virtual memory 
systems use some form of this algorithm. 

F. The theoretical upper and tower bounds on the paging 
performance are computed by applying the methods of Chapter 3 to 
the sector trace of step A and compared with the performance found 


in step E. 


In order to identify the parameters of the page fetch function, 
FFp(|Mp|,N,Ma,Sta,Fd, Rigy ), which are associated with each curve 


in the following graphs, these conventions are presented. 


1. [Mp], the size of the primary memory in pages, is used as the 
horizontal axis of the graphs. In addition to the values of |Mpl, 
the horizontal axis is tagged with the memory size in K bytes 
(K=1824). . 

2. N, the page size in these experiments, is 4896 bytes. 

3. A partition II of relocatable sectors into clusters is denoted 


by [Ix or Ty for ease in interpreting the results in the following 
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figures. [x is used to denote a "bad" partition, i.e., one which 
tends to maximize or produce a relatively large value of FFp. My 
denotes a “good” partition, i.e., one which tends to minimize the 
value of FFp. 
A particular value of My is denoted by specifying the intersector 
reference matrix and the clustering procedure which produced it. 
For example, 

Ty (W, T=2588, CNN) 
is defined to denote the value of My which is computed from the 
working set matrix, W, with a window size of T=2588, using the 
constrained nearest neighbor procedure, CNN. 
The intersector reference matrix models used to specify a 


particular [My will be identified in terms of the following symbols: 


W = outside working set matrix model 
W’= inside working set matrix model 
T = window size of working set model 
= LRU sector stack matrix model 


sector stack distance 


xz oOo Cc 
u 


= Hatfield and Gerald matrix model 


The clustering procedures used to specify a particular value of Illy 


will be one of the following: 
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CNN = constrained nearest neighbor 
CFN = constrained farthest neighbor 
CAN = constrained average neighbor 


CANW = constrained average neighbor weighted 


UNN 


unconstrained nearest neighbor 

UFN = unconstrained farthest neighbor 

UAN = unconstrained average neighbor 

UANW = unconstrained average nejghbor weighted 

HG = Hatfield and Gerald method 

SIP = sector interchange procedure 

ICB = intercluster bond method 

As another example, 
My (U,0=28, 1CB) 

represents the partitjon named [ly when it is computed from U, with D=28, 
using the ICB procedure. 

In the presentation of ieee experimental results, We chose to 
denote the program structure in terms of Il instead of the sector 
ordering SO, because the clustering procedure is clearer when stated in 
terms of Il. However, the reader should be aware that the blocks of the 
partition are allowed to cross page boundaries in order to eliminate 
holes in the address space. 

4. A particular value of SOTa will be denoted by SOT, , SOT,, and 
SOT; for the three phases 1, 2, and 3 respectively. Furthermore, 
SOTia, SOTib, etc., will represent the sector trace of the ith phase 


from input program a, b, etc, when the distinction is important. For 
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example, SOT, a denotes the sector trace of Phase 2 from input program 
a. Note that all of the sector traces in the simulations are ordered 
pairs (S,0) where S is the sector and 0 is the offset referenced. This 
is necessary because we are allowing sectors to cross page boundaries. 
5. The fetch and replacement algorithms are denoted as before, i.e., 


Fd, Riey, Ro, etc. 


In order to find a IIx that tends to maximize the value of FEp, we 
investigated random sector Grdertnes: sector orderings based on sector 
sizes, lexical orderings (i.e., alphabetical on some character in the 
sector name), and sector orderings produced by the following procedure, 
called BAD. Take the list L of m sectors, ordered according to their 
position in the address space under a good program structure, and do the 


following to produce a partition IIx of the m relocatable sectors into n 


logical pages. 


1. Take the first n sectors of L and put each of them into one of 
n separate lists. 

2. Take the next n sectors of L and put each of them into one 
of the above n separate lists. 

3. Repeat 2 until there are no more sectors in. L. Then, 


4. the collection of the n separate lists becomes IIx. 


It turned out that al! of the above methods of generating [lx usually 


produced a IIx that caused the value of FFp to be very large. 
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6.2 Restructuring Phase 1 


Throughout this section we use the same sector trace, SOT,. In 
section 6.5 we compare the results of program restructuring over several 
sector traces. Our resuits support the claim of Hatfield and Gerald, 


"many commonly used programs are rather insensitive to input data." 


However, we did attempt to choose a program for tracing that 
contained most of the features of the language and that was relatively 
long. That is, this program was not trivial. The: sector trace of this 
program contained 7,521,285 references. Moreover, |SOT, |=2,881,827, 
|SOT3 |=3,859,636 and |SOT. |=1,668,542. 


The value of x is fixed for Figures 7-14 and represents the 
program structure B, which occurs when the. sectors are arranged in the 
address space according to their size. Even though the structure 
produced by the BAD procedure resulted in slightly more page fetches for 
most memory sizes, we selected [IIx based on the sector lengths (calid 
B, } because this represents a plausible method of loading sectors used 
by gome operating systems. The choice of [lx is used as a basis for 
itlustrating the actual improvement in the paging performance which can 


occur for real programs which are restructured according to some Ily. 
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' 6.2.1 Constrained Procedures 


The curves of Figures 7 and 8 and the lower.curves, labeled C, D, 
and E, of Figure 9 show the ratio of the page fetch functions 
FFp(|Mp|,N,IIx,SOT, ,Fd,Rigy) and 
FFp(|{Mp],N,MMy,SOT, ,Fd,Ripy) as a function of primary memory size 
|Mp}| in pages and as a function of IIx and Ily where [ly is constrained. 
fly is constrained when the blocks of My correspond to the clusters 
produced by any clustering procedure and the size of these clusters is 


constrained to be less than or equal to the page size. 


These figures reveal that the orderings of the relocatable sectors 
into primary memory can have substantial influence on the paging 
performance of virtual memory systems. Moreover, they illustrate that 
substantial improvements in paging performance occur over a relatively 


wide range of primary memory sizes. 
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69 A> Try (U, D= 20,CFN) 
66 B> ry (W,T = 2500, CANW) 
65 C> Ty (W,T =2500, HG) 
60 D=> Try (W,T= 2500, SIP) 


a N= 4096 Bytes 
54 

|SOT, |= 2,001,027 
5| 

Tx = By, 
48 


o. 10 (5 20 25 
20K 40K 60K 80K 100K 


FIGURE 7 FFp(IMpl,N, 1Tx ,SOT Fd, R, gy)/FFp (IMpl,N, Ty, 
SOT, Fd, Rigy) vsiMpl FOR PHASE | OF AED COMPILER 
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72 
69 ' 
A> Try (W, T = 1000, CANW) 
66 
B=> Try(U,D=I5, CNN) 
63 
C => Try (W,T=1000, CAN) 
60 
oo D=> Try (W,T= 1000, HG) 
54 
5 | N = 4096 Bytes 
48 |SoT,l=2,001,027 
45 TTx = B, 


O 5 10 15 20 25 
20K 40K 60K 80K lOOK 


FIGURE 8 FFp (IMpl, N,1Tx,SOT,, Fd »Ry py)/ FFp(IMpl,N, TTy, 
SOT), Fd, R, gy) vs IMp| FOR PHASE | OF AED COMPILER 
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The degree of improvement in paging performance shown in these figures 
(i.e., 7-8) is significantly larger than any previously published 
improvements obtained by restructuring. One rationale for this is that 
the intersector reference matrix models based on the working set acd the 
LRU stack distances capture the intersector activity upon which paging 
depends. That is, the value, Cij, of the entry in the intersector 
reference matrices used in these experiments may have a strong tendency 
to be proportional to the number of page fetches which will go auay if 
sector j is grouped with sector i. In particular, note the improvement 
in paging performance depicted by curves E, D, and C of Figure 9, which 
use the HG clustering technique on the sector working set intersector 
reference matrix. This improvement is about twice as much as that 
reported by Hatfield and Geraid [Hl] when the same clustering procedure 
is applied to the HG intersector reference model. Recall that the HG 
intersector reference model is the same as the sector working set model 


when Te=l. 


179 


69 A=> Try (W,T=1000, ICB) 
B => Try (W, T=2500, ICB) 
C > Try (W,T=!1500 , HG) 
D => TTy ( W, T= 2500 ,HG) 
E => Try (W, T=5000,HG ) 


54 / 
5| N =4096 Bytes x 

48 IsoT,| =2,001,027 / 
45 TT x = B, : 


0 5 10 15 20 25 
20K 40K 6 OK 80K lOOK 


FIGURE 9 FFp (IMpI,N,17x,SOT,, Fd, Rugu)/FFp(IMpl,N, Ty, 


SOT),Fd,R, 24) vs|Mpl FOR PHASE | OF AED COMPILER 
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6.2.2 Unconstrained Procedures 


The unconstrained clustering procedures presented in Chapter 5S 
cluster the relocatable sectors into natural clusters without any 
constraint on the sum of the sector sizes making up a cluster. To date, 
no work has been reported in the literature which incorporates this 


rather simple idea into clustering procedures. 


The curves identified by labels A and B of Figure 9 show the 
improvement in paging performance which occurred when natural clusters 
were formed. These natural clusters were produced by the intercluster 

‘bond method, ICB, using the sector working set intersector reference 
model. These curves illustrate that natural clusters can provide 
significantly better improvements in the paging performance than the 


improvement provided by the constrained clustering techniques. 


The curves of Figure 18 (except curve 0D) show the improvement in 
paging performance for several unconstrained clustering techniques. The 
curve labelled 0 in Figure 18 shows the improvement in paging 


per formance provided by the existing compiler structure. 
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69 A= Try (W,T=2500, UANW) 
66 B => Ty (W,T =2500, ICB) 
63 C => Try (U, D =15, UANW) 
60 D => Try (Compiler) 

57 


N =4096 Bytes 
ISo7,| =2,001, 027 


Tx = By, 


FIGURE 10 FFp (IMpl,N, TTx,SOT,,Fd,R, py)/FFp(IMpI,N, Ty, 
SOT,Fd, Ri gy) vs |Mp! FOR PHASE | OF AED COMPILER 
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Recall that all these improvements are relative to the program structure 
IIx formed by arranging the sectors into the eaaress space in order of 
their sizes. Curve D shows that the existing compiler structure is 
substantially better than that provided by [IIx and significantly worse 


than any of the unconstrained techniques. 


Figure 11 shous the effects of the unconstrained average neighbor 
weighted bond procedure UANW on the paging performance as a function of 
T for the working set intersector reference model W. The significant 
characteristics of the curves shown in Figure 11 is that the 
improvements in paging performance are relatively the same over a broad 


range of T values. 


Note the tendency of the curves in Figure 11 to peek in the center 
region of the primary memory sizes. This tendency is due primarily to 
the following two “principles” pushing a curve together from both sides. 
The first principle is that for small values of |Mp|, one clustering 
method “cannot win" over another method. The second principle is that 
‘for large values of [Mp], one clustering approach "cannot lose" over 
another approach. However, in the middle range of the values of |Mp|, 
there may be enough primary memory available to contain most of the 
sectors referenced close together in time when they are clustered 
together into groups. Note that in this region there can be tuo levels 
of clustering for good structures. The first fevel is that sectors are 


clustered together by the clustering procedure. The second level is 
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72 
69 A> Try (W,T =1000,UANW) 
G9 B> Try (W,T=25000, UANW) 
63 

C > Try (W, T=5,000, UANW) 
60 

N= 4096 Bytes 
57 
54 |SOT,|=2,001,027 


5 TTX = B, 


5 10 15 20 25 
20K 40K 60K 80K |OOK 


FIGURE I! FFp (|Mpl,N,1Tx,SOT, , Fd, RUgy)/FFp(Mpl,N, Ty, 
SOT,,Fd,R, Ry) vs IMs| FOR PHASE | OF AED COMPILER 
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that clusters are clustered together by the paging mechanism. 


6.2.3 Theoretical Bounds 


In Figure 12 the performance for the best program structure, i.e., 
the one produced by Iy(W, T=2588,UANW), is compared with the theoretical 
best performance given by Theorem 8. Observe that Table 3 precisely 
defines the parameters for the curves shown in Figure 12. Curve B shows 
the ratio of the page fetches experienced 6 the program under the 
structure produced by My (W,T=2588,UANN) to the theoretical lower bound 
on the page fetches. That is, curve B depicts 
FFp(|Mp{,N,My,SOT, ,Fd,Ripy )/the Lower Bound. This ratio can 
never be less than one and would be equal to ore when the theoretical 
best performance occurred for a given program structure. Figure 12 
shows several significant characteristics. The performance produced by 
the structure [My (W, T=2588,UANW) is relatively close to the lower bound 
for large regions of primary nomen size. Furthermore, it is close to 
the fower bound in the primary memory regions of low paging rates. This 
latter fact can be seen by observing the curves in Figure 13. Curve D 
of Figure 13 shows the number of page fetches for the structure 
My (W, T=2588, UANW) , and curve A shows ‘ie theoretical lower bound for. the 


number of page fetches over all Ily. 
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69 See Table 3 for notation 
66 A>FFp (1TX,R, gy )/F Fe (Ty, Ry py! 


63 B=>FFp (TTy,R )/ Theoretical Min. FFp 


LRU 


60 C => Theoretical Max FFp/FFp (1Tx,R, py) 


of 
a D=> FFp (1Tx,R, py) /FFp (TTy,Ro) 
5 | E=> FFp (Tly,Ro)/Theor. Min FFp 


48|- Try (W,T =2500,UANW) 
45 Tx =Bl 

42 N = 4096 Bytes 

39 |soT,| = 2,001,027 


<) <) 10 IS 20 29 
20K 40K 6 OK 80K lOOK 


FIGURE 12 Comparison of Actual and Theoretical Ratios of FFp 
FOR PHASE ! OF AED COMPILER 
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| Graph A is: 
FFp(|Mp|,N,Ix,SOT, ,Fd,Rigy )/FFp|Mp|,N,fy,SOT, .Fd,Ripy ) 
Graph B is: 


FFp(iMp|.N,lly,SOT, ,Fd,Rigy )/FFst|tHs N,SS"),SOT ,Fd,Ro) - 4 


Graph C is: 
FFs({Ms} = {Mp|,SOT, ,Fd,Rigy )/FFp(|Mp|,N,lix,SOT, ,Fd,Ripy ) 


Graph D is: 
FFp({Mp|,N,x,SOT, ,Fd, Rigy }/FFp((Mp|,N,Mly,SOT, .Fd,Ro) 


Graph E is: 


FFp(iMp|,N,ly,SOT, ,Fd,Ro)/FFs(jMs| = f, (jMp],N,SS*),SOT: .Fd,Ro) - A 
#, (2,N,98) /2 


where IIx = Bl, Iy(W,T = 2568,UANH), N = 4896 Bytes 
\SOT| = 2,801,827 


Note that FFs(jMs| = f, (jMp|,N,SS*),SOT; ,Fd,Ro) - A 
rete ne Se (2,N,55)/2.——SOS 


shown in B and E above is the lower bound of FFp given 
in Theorem 6. . 


Note that FFs(|Ms| = |[Mp|,SOT, .Fd,Ripy ) 
shown in C above is the upper bound of FFp given by 
Theorem 3. 


Table 3 
Parameters for Curves in Figure 12 
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Curve B of Figure 12 indicates that the lower bound may be loose 
for very small values of |Mp| or that the structure M[y(W, T=25868, UANW) 
does not cluster sectors very well for small vues of IMp}. The 
conjecture is that the lower bound may be loose for very small values of 
|IMp| since this phenomenon is observed in all of our experiments. This 
is not a serious practical drawback, because even for the lower bound 
the paging activity is prohibitively large for very small |[Mpj. Since 
the lower bound is valid over all replacement algorithms, we compared 


the ratio of the performance of the good structure IIy using OPT 


replacement to the lower bound. This ratio is curve E of Figure 12. 


Curve C of Figure 12 illustrates the ratio of the theoretical upper 
bound given by Theorem 3 to the bad performance. The bad performance is 


the number of page fetches produced with the structure [lx. 


The upper bound is relatively close to the “worst” per formance 
resulting from the structure IIx for most values of |Mp|]. For large 
values of |Mp| the upper bound is not very tight. The upper bound will 
be tight as long as the sectors which are clustered into a page are 
never used together when that page is in Mp. However, as the size of Mp 
increases, it becomes more and more difficult for this condition to be 
satisfied. Hence, the upper bound grows very rapidly for values of |Mp| 
approaching the length of the program. However, for values of |Np| in 
the region where the program would probably be run, the upper bound is 


reasonable. 
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Figure 13 shous the number of page fetches given by: 


A. the tower bound. 

B. the upper bound. 

C. the bad structure, Tx. | 

D. the good structure, Hy{l, 1=2588,UANN) under LRU. 
E. the good structure, Ty WW, T~2588, UANW) under OPT. 


Figure 14 is simply the values for curves A, C, and 0 of Figure 13 shoun 


at a much larger scate. 


In summary, Figures 3-14 show that the paging performance may vary 
by a factor of 12 to 38 fer large regions of primary wemory size |Mp|. 
This occurs when the unconstrained clustering procedures are used in 
conjunction with the sector working set and the LRU stack intersector 
reference matrices; that is, for My{W,1=2588,UANW), Ily(W, T=2580, ICB) 
and Tly(U,D=15,UANW). The use of clustering precedures which cluster . 
sectors into natura! clusters can produce program structures which 
require significantly fewer page fetches than required. by program 


structures based on constrained clustering procedures. 
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60k Q 9 ¢ | 
x A= FFs (|Ms| =f, (IMp|,N,SS*)SOT*Fd,Ro)-A 


55k f, (2,N,SS)/2 


B =>FFs (IMsl=|Mp|,SOT,,Fd,R, py) 


50k : 
C >FFp (IMpl,N, 1Tx,SOT,,Fd,R, py) 
D=>FFp(IMpl, N, Ty, SOT), Fd, R, py) 
45k , 
E=>FFp(|Mpl, N,1Ty, SOT,,Fd, Ro) 
4 = 
TTy (W,T =2500,UANW) 
35 k : 
N = 4096 Bytes 
|SOT,[= 2,00! ,027 
30k xX © 
25k 
20k 
1 Sk . b a 
» B 
Theoretical 
\ : : J. Worst 
|Ok alee: f Case 
J D 0 
A E ) , 
5k r \x : e ny 
heore tical a 
Best xD : 
Case “yoo a On 
CoS Sea GS eS ee a 
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FIGURE 13 Total Page Fetches vs |Mp| 
FOR PHASE | OF AED COMPILER 
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A, D, and C are the 


5.5 k same as in Figure 


5.0 k 


4.5k 


4.0k 


3.5k 


3.0k 


25k 


2.0k 


1.5k 


1.Ok 


0.5k 


> 29 = 


5 10 15 20 25 
20K 40K 60K 80K l0OK 


FIGURE !4 Enlarged Scale for Curves A,C,and D of Figure FOR 
PHASE | OF AED COMPILER 
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6.3 Restructuring Phase 2 


Figure 1S shows the results of restructuring Phase 2 over sector 
trace SOT,, where |SOT, |=1,668,542. Table 4 precisely defines the 
curves of Figure 15. The bad order [lx = By for Phase 2 is computed by 
the procedure BAD, which is compared to the order produced by 
Ny (W, T=2588,UANW). The curves of Figure 15 may be interpreted similarly 
to those of Figure 12 of Phase 1. The variation in the paging 
performance of Phase 2 as a function of program structure is not aa 
large as that of Phase 1. However, the largest improvement in the 
paging performance of Phase 2 occurs when approximately one half of 


Phase 2 can fit into primary memory. 
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69 See Table 4 for full complete explanation of curves. 
A=> FFp (TTx)/FFp (TTy) where Thx = B2 and Ty (W,T = 2500, ICB) 


66 

ce B => FFp (TTx)/FFp (Tly) where Thx =B2 and Try (wW,T =2500, UANW) 

aa C=> FFp (TTx)/FFp (Ty) where TTx=B2 and Thy = Compiler Order 
D> FFp (Tly)/ Theor. min FFp where Try (W, T= 2500,UANW) 


57 E => Theor. Max FFp/FFp (TTx) where Tx =B2 
54 |SOTp|= 1,660, 542 


25 
1OOK 
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Graph A is: 
FFp(|Mp],N,Ilx,SOT, ,Fd,Rigy )/FFp((Mp|,N,Mly,SOT. ,Fd,Rigy ) 
IIx = B2 and Iy(W,T = 2588, ICB) 


Graph B is: 
FFp(|Mp|,N,IIx,SOT, ,Fd,Rigy )/FFp(|Mp|,N,My,SOT, ,Fd,Riry ) 
IIx = B2 and My({W,T = 2588,UANW) 


Graph C is: 
FFp(|Mp|,N,IIx,SOT, ,Fd,Ripy )/FFp(|Mp],N,iy,SOT. ,Fd,Riay ) 


IIx = B2 and My = Compiler Order 


Graph D is: 
FFp(|Mp|,N,Ily,SOT, ,Fd,Rigy )/FFs(|Ms| = f; ([Mp|,N,SS* ),SOTD ,Fd,Ro) - A 
| pity 
Ty(W,T = 2588, UANW) 


Graph E is: 
FFs((Ms| = [Mp], SOT, ,Fd,Ripy )/FFp((Mp|,N,ix,SOT, ,Fd,Riay ) 
IIx = B2 


Table 4 


Parameters for Curves in Figure 15 
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6.4 Restructuring Phase 3 


Phase 3 is restructured from a sector trace SOT; which contained 
3,859,636 references. The program structure. IIx is a random ordering of 
sectors into the virtual address space. Program structures 

My (W, T=2588, 1CB), My (W, T=2588,UANW) and 

My (U,0=26, ICB) 
produced substantial improvements in the paging performance over . 
IIx =B;. These improvements are illustrated in curves A, B, and C of 
Figure 16. These curves have the highest peaks of any improvements over 
sector orderings that we found. Curve 0 of Figure 16 shows the ratio of 
the paging performance obtained from IIx to the performance of the 
existing compiler ordering. The theoretical lower ‘and upper bounds are 


presented in Figure 17 in the same manner as for Phase 1 and 2. 


Now we present a few general comments about Phase 1, 2, and 3. All 
three phases indicate that significant variations in paging per formance 
can occur for different arrangements of the relocatable sectors in 
virtuat memory. The unconstrained Siysterina procedures, ICB and UANW, 
produced the best peéehan performance over all memory sizes for all 
three phases. The constrained procedures are not shown for Phases 2 and 
3 since they produced the same relative improvement in these phases as 
in Phase 1. The theoretical lower bounds are relatively good indicators 
of the best paging performance of all three phases for al! but the 


smallest primary memory sizes. 


A=>TTy (W,T = 2500, ICB) 
B =>TTy( WT =2500, UANW) 
C >TTy(U,D=20, ICB) 

D >TT y(Compiler) 

N =>4096 Bytes 

| SOT, |= 3,859, 636 

Tx = Bs 


5 10 15 20 25 30 
20K 40K 60K 80K lOOK ~—- 120K 
FIGURE 16 = FFp (|Mpl, N,1x,SOT3,Fd, Ri py)/F Fp (|MpIN, Try, 
SOT,,Fd, Ri py) vs |Mp| FOR PHASE 3 OF AED 


COMPILER 


196 


72 
xox 
69 A=> Try (W,T = 2500, ICB) : 
66 B > Try (W,T = 2500, UANW) A 
63 C > Try (U,D=20,1CB) . 
60 D=> Try (Compiler ) 
57 N= 4096 Bytes 
54 . 
lsoT,|=3, 859, 636 
5! TTx = Bs; 
48 
E=> FFp (IMpl,N, TTy,SOTS Fd, R, oy) / 
45 FFs (|Ms|=f, (iMp1,N, SS“), SOT$ , Ro 
42 f{,(2,.N,SS)/2 
~ Try (U,D= 20, 1CB) 
36}--  F=> FFs (IMsl = Mp! ,SOTs Fd, Ry py) | 
33 FFp ({Mpl,N, Tx, SOT3,Fd,Ri ay) 
30 ie 
27 
24 
2| 
18 
15 
12 
9 E 
6 “a, eae Fe 
3 "#: 6 o : 
ms : Kum ¥ f : y -@,"~ 
SO eae ain Se 
fe) 5 10 15 20 25 
20K 40K 60K 80K 1IOOK i20K 


FIGURE 17 FFp(IMp|,N,1Tx,SOT, Fd, Rp gy)/FFp (IMpl,N,TTy, SOT), Fd, 
Ruru) vs IMpl FOR PHASE 3 OF AED COMPILER 
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6.5 Effects of Input Data 


In order to establish the effect that the input program to be 
compiled has on the paging performance, we conducted the following 


experiments: 
Experiment 1: 


A. We took the above sector trace SOT, and computed the program 
structure ITy(W, T=2588,UANW). 

B. We measured a second program trace SOT, a which corresponds 

to a completely different program and restructured the compiler to 
get IIya(W, T=2588,UANW) based on SOT, a. 

C. A third sector trace SOT, b was measured, and, based on this 
sector trace, the program structure [lyb(W, T=2588,UANW) was 


computed. 


All three of the program structures, [y, Ilya and [yb should tend to 
minimize the paye fetches for the traces SOT, , SOT, a, and SOT, b 
respectively. However, will the structures specified by [Ilya or by Myb 


tend to minimize the page fetches for SOT, ? - 
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Figure 18 contains all the information shown in Figure 13 for Phase 
1. That is, it shows the value of the page fetch function FFp for 
SOT, and [My as curve D, and it shows the other curves of Figure 13 for 
visual comparison. Curve F in Figure 18 represents the value of FFp as 
a function of the same reference behavior SOT, and Mya. Curve G 
illustrates the value of FFp as a function of the same reference 


behavior SOT, and [yb. 


Therefore, the curves D, F, and G represent the paging per formances 
-of Phase 1 of the compiler for a single sector trace and three different 
partitions of sectors into clusters. The results of this experiment 
reveal that a good program structure generated from one sector trace is 


a good program structure for other sector traces. 
Experiment 2: 


Now we give another experiment. For My, Mya and Myb from the above 
experiment, we use the BAD procedure on each II to get IIx, Ilxa, and IIxb 
respectively. Then, using the same sector trace SOT,, the following 


ratios are computed and plotted in Figure 19. 


A. FFp(..,[x,SOT, ,..)/FFp(..,My,SOT, ,..) 
B. FFp(..,Mlxa,SOT, ,..)/FFp(..,Mya,SOT, ,..) 


C. Fepl..,[[xb,SOT, ,..)/FFp(..,Myb,SOT, ,..) 
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A=> FFs (IMsl =f, (IMpl, N, SS* SOT,*Fd,Ro)-A 
55k f,(2,N,SS)/2 
B> FFs(|Msi =IMpl, SOT, ,Fd,R, py) 
1 
ome ’ C=> FFp (IMpI ,N,1Tx,SOT),Fd, Ri p.) 
f D=>FFp(IMpI,N, Ty, SOT,,Fd, Riru) 
45k 1 4 
E=>F Fo(IMopl,N, TTy, SOT, ,Fd, Ro) 
: 1 ; 
40k \ Tx =B, 
\ TTy (WT =2500, UANW) 
1 ° 
35k : N = 4096 Bytes 
ISOT,|= 2,001, 027 
i) 
30k ' , 
* \W F = FFp (1 Mpl,N, Tyg,SOT,.Fd, Ri gy) 
( TT¥q (W,T = 2500,UANW) FROM SOT, 
25 k i a: | 
Mae = FFp (|Mp|,N,1Typ,SOT,,Fd, Ry py) 
see Ce Try, (W, Tp =2500,UANW) FROM SOT), 
‘ e 
. eo 
X B 
15k > \' ° p 
th 
\ = Q 
\ c 
Q . Theoretical Worst 
Ok ‘ x Q , Case 
“\e 
5k Ro : : 
Theoretical -¥>X_ Ny Q Q 
Best Case Ny SSS . 
™ ~ SS 8 
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20K 40K 60K 8 OK 
F1GURE 
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18 Total Page Fetches vs |Mp| FOR PHASE | OF AED 
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69 A=>FFp(\Mpl, N,1Tx, SOT,,Fd, Ry ay)/ FFp(IMpl,N,TTy,SOT,,Fd, 
66 Rury) where TTx and Try (W, T=2500,UANW) are based on SOT, 
63 

B=>FFp(IMpl, N, 1Tx9,S07,Rd, Ri ay )/ FFP (Impl, N, Tyo, SOT, Fd, R, 2) 
60 where TTxq and TTy, ( W, T=2500, UANW) are based on SOT), 
57 


C=>same as B except TTx, and TTy, are based on SOT), 


5 A NI 


0 e) 10 I5 20 25 
20K 40K 60K 80K lOOK 


FIGURE 19 Comparison of Page Fetch Ratios for Different Program 
Structures FOR PHASE | OF AED COMPILER 
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These ratios are the improvements in paging performance over the same 
sector trace for three pairs of program structures. Each pair consists 
of a BAD structure and a good structure. Furthermore, each pair is 
constructed from a different sector tedees fouavas: the soaaiate 


improvement in paging performance for each pair is nearly the same. 
Experiments 3 and 4: 


Experiments 3 and 4 for Phase 2 and 3 respectively are quite 
similar to Experiment 1 for Phase 1. The only difference is that, in 3 
and 4, the ratios of FFp(..,[y,SOT> ,..)/FFp(..,Mya,SOT>,..) and of 
FFp(..,My,SOT,,..)/FFp{..,Myb,SOT,,..) are plotted as shown in 
Figures 28 and 21 instead of the magnitude of these values of FFp shoun 
in Figure 18. In Figure 18 it is difficult to distinguish between the 
three curves because of the scale problems. Figures 28 and 21 do away 
with the scale problems but do not show the relationship of these values 
to the overall picture as is done in Figure 18. From Figures 28 and 21 
we observe that a good program structure computed from one sector trace 


turns out to be a good program structure for another sector trace. 
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3.0 A= FFp(...1Ty, SOTp...)/FFp (... Tyg, SOT,,...) 


= FFp(... Ty,SOT,...)/FFp(... Ty, ,SOT»,...) 
where Tly is based on SOT» 


2.0 TTY, is based on SOT “ 

oe Ty, is based on SOT,, 

fe Xx BX 

1.0 cals 
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2 

: 5 10 15 20 25 
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FIGURE 20 Ratios of Page Fetches For TT Based on Different 
Sector Traces FOR PHASE 2 OF AED COMPILER 


A&B same as Fig. 20 except TIy is based on SOT; 
Tyg is based on SOT,, 
TTy, is based on SOT), 
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FIGURE 2I Ratios of Page Fetches For TIT Based on Different 
Sector Traces FOR PHASE 3 OF AED COMPILER 
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CHAPTER 7 


DISCUSSION AND CONCLUSION 


7.1 Introduction 


This report has presented theoretical and experimental results 
which show that program restructuring has a significant effect on the 


paging performance of virtual memory systems. 


7.2 Summary 


The problem of restructuring programs to improve their paging 


performance in virtual memory systems was presented in Chapter 1. 


In Chapter 2 we formalized the notion of the page fetch function 
and the sector fetch function. The page fetch function models the 
paging behavior, and the sector fetch function models the sectoring 


behavior. 


In Chapter 3 the sector fetch function was used to produce upper 


and lower theoretical bounds in the page fetch function over all 
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reorderings of the relocatable sectors into the address space. 


Intersector reference models based on sector working sets and LRU 
stack distances were developed in Chapter 4. In Chapter 5S several 
clustering methods were developed which used the intersector reference 


models to produce a restructured program. 


In Chapter 6 the effect of program restructuring on the paging 
per formance of real programs was investigated empirically and 
theoretically. In particular, we showed that improvements in paging 
performance of factors of 28 to 48 is not uncommon for relatively large 


regions of primary memory size. 


7.3 Further Work 


The research reported in this report provides a basis for 


additional investigation in several areas of program restructuring. 


The work described in this report addresses a problem that its as 
hard as the seemly intractable problems studied by Cook [C5] and Karp 
{K6J]. Recent work by several people has revealed fast algorithms for 
near optimal scalutions to some of these problems. The clustering 
techniques described in Chapter 5 have been shown of value for 


particular but not trivial examples that occur in practice. It would be 
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of considerable interest to know to what extent these techniques can be 
relied on over all possible sector traces. Can our techniques be shown 
to yield solutions that come within a factor of two of our lower bounds? 
If not, are there algorithms that do come near our lower bounds? 


Alternatively,can our lower bounds be improved? 


We did not investigate the problem of sector duplication in this 
thesis. We claim that the results of Chapter 3 can be applied in a 
straightforward manner to produce tower bounds on the paging per formance 
when sector duplication is allowed. Another related problem is how to 
incorporate sector duplication into the intersector reference models and 


into the clustering procedures. 


Another area is the problem of deciding when it is best for sectors 


to cross page boundaries and when it is best to have holes in pages. 


An ongoing research project between the author and Don Hatfield of 
IBM is to use the theoretical results of Chapter 3 to evaluate the 
potential benefit of reprogramming and then restructuring a very large 
data base system. This targe data base system has sectors which are 
over 1@ pages long. For example, Theorem 1 can be used to predict the 
theoretical best Aauimaypentoreante if the large data base system is 
broken up into k sectors per page. Thus, the problem is to determine 
the k that provides the best theoretical improvement and then use the 
magnitude of this improvement as a basis for deciding whether or not 


reprogramming is advisable. 
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